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We consider a problem in random matrix theory that is inspired by quantum information theory: 
determining the largest eigenvalue of a sum of p random product states in (C d )® fc , where k and p/d k 
are fixed while d — > oo. When k = 1, the Marcenko-Pastur law determines (up to small corrections) 
not only the largest eigenvalue ((1 + ^p/d k ) 2 ) but the smallest eigenvalue (min(0, 1 — \/p/d k )' 2 ) 
and the spectral density in between. We use the method of moments to show that for k > 1 the 
largest eigenvalue is still approximately (1+ \/p/d k ) 2 and the spectral density approaches that of the 
Marcenko-Pastur law, generalizing the random matrix theory result to the random tensor case. Our 
■ bound on the largest eigenvalue has implications both for sampling from a particular heavy-tailed 

distribution and for a recently proposed quantum data-hiding and correlation-locking scheme due 
to Leung and Winter. 

Since the matrices we consider have neither independent entries nor unitary invariance, we need 
' to develop new techniques for their analysis. The main contribution of this paper is to give three dif- 

ferent methods for analyzing mixtures of random product states: a diagrammatic approach based on 
Gaussian integrals, a combinatorial method that looks at the cycle decompositions of permutations 
Ch ' and a recursive method that uses a variant of the Schwinger-Dyson equations. 
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I. INTRODUCTION AND RELATED WORK 
A. Background 



(N 
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A classical problem in probability is to throw p balls into d bins and to observe the maximum occupancy of any 
bin. If we set the ratio x = p/d to a constant and take d large, this maximum occupancy is 0(lnd/lnlnd) with high 
probability (in fact, this bound is tight, but we will not discuss that here). There are two natural ways to prove this, 
which we call the large deviation method and the trace method. First, we describe the large deviation method. If the 
t-H ' occupancies of the bins are z±, . . . ,Zd, then each Zi is distributed approximately according to a Poisson distribution 
ON , with parameter x; i.e. Pr[z^ = z\ as x z /e x z\. Choosing z ^> lnd/lnlnd implies that Pr[z^ > z] <C 1/d for each i. 
Thus, the union bound implies that with high probability all of the Zi are < (9(lnd/ lnlncf). More generally, the large 
deviation method proceeds by: (1) representing a bad event (here, maximum occupancy being too large) as the union 
of many simpler bad events (here, any one Zi being too large), then (2) showing that each individual bad event is very 
unlikely, and (3) using the union bound to conclude that with high probability none of the bad events occur. This 
method has been used with great success throughout classical and quantum information theory (T3, [III [H| . 

This paper will discuss a problem in quantum information theory where the large deviation method fails. We will 
show how instead a technique called the trace method can be effectively used. For the problem of balls into bins, the 
trace method starts with the bound maxz™ < z" 1 + . . . + z™, where m is a large positive integer. Next, we take the 
expectation of both sides and use convexity to show that 

E[maxzJ < (E[maxz™])™ < d™ (E[z^])- . 

Choosing m to minimize the right-hand side can be shown to yield the optimal In dj In In d + 0(1) bound for the 
expected maximum occupancy. In general, this approach is tight up to the factor of d}/ m . 

The quantum analogue of balls-into-bins problem is to choose p random unit vectors \(fi), . . . , \ip p ) from C d and to 
consider the spectrum of the matrix 

p 
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where we use tp to denote |y>)(<p|. Again we are interested in the regime where x = p/d is fixed and d —¥ oo. We refer 
to this case as the "normalized ensemble." We also consider a slightly modified version of the problem in which the 
states \(f> s ) are drawn from a complex Gaussian distribution with unit variance, so that the expectation of (ip s \ip s ) is 
equal to one. Call the ensemble in the modified problem the "Gaussian ensemble" and define M p d — Yl P s =i Note 
that M p ,d = where $ = Y^!s=i \f)( s \ is a p x d matrix where each entry is an i.i.d. complex Gaussian variable 

with variance 1/d. That is, $ = Es=il/j=i( a sj + with a s j,b s j i.i.d. real Gaussians each with mean 

zero and variance l/2d. 

What we call the Gaussian ensemble is more conventionally known as the Wishart distribution, and has been 
extensively studied. Additionally, we will see in Section III Al that the normalized ensemble is nearly the same as 
the Gaussian ensemble for large d. In either version of the quantum problem, the larger space from which we draw 
vectors means fewer collisions than in the discrete classical case. The nonzero part of the spectrum of M has been 
well studiedJTU, |32|, HH, and it lies almost entirely between (1 ± \/x) 2 as d — > oo. This can be proven using a variety 
of techniques. When M is drawn according to the Gaussian ensemble, its spectrum is described by chiral random 
matrix theory [H, [33[ ■ This follows from the fact that the spectrum of M has the same distribution as the spectrum 
of the square of the matrix 

( 4 ° t) ■ « 2 » 

where $ is defined above. A variety of techniques have been used to compute the spectrum]^, [HI- The ability to 
use Dyson gas methods, or to perform exact integrals over the unitary group with a Kazakov technique, has allowed 
even the detailed structure of the eigenvalue spectrum near the edge to be worked out for this chiral random matrix 
problem. 

A large-deviation approach for the i<1 case was given in [2^, appendix B]. In order to bound the spectrum of 
M P: d : they instead studied the Gram matrix M p d :— , which has the same spectrum as M. Next they considered 
{4>\M' d \4>) for a random choice of \<p). This quantity has expectation 1 and, by Levy's lemma, is within e of its 
expectation with probability > 1 — exp(0(de 2 )). On the other hand, \<fr) £ C p , which can be covered by an e-net of 
size exp(0(pln 1/e)). Thus the entire spectrum of M' d (and equivalently M Pi <j) will be contained in 1 ± 0(e) with 
high probability, where e is a function of x that approaches as x — > 0. 

In this paper, we consider a variant of the above quantum problem in which none of the techniques described above 
is directly applicable. We choose our states \<p s ) to be product states in (C d )®' c ; i.e. 

Ws) = Ivi>®l^>®---®|^), 

for . . . , \<Pg) <E C d . We choose the individual states |y>") again either uniformly from all unit vectors in C d 
(the normalized product ensemble) or as Gaussian-distributed vectors with E[(y?"|<£")] = 1 (the Gaussian product 
ensemble). The corresponding matrices are M p ^,k and M Pl d,k respectively. Note that k — 1 corresponds to the case 
considered above; i.e. M p 4 1 = M p d and M p d,i — Mp,d- We are interested in the case when k > 1 is fixed. As above, 
we also fix the parameter x = p/d^, while we take d — > 00. And as above, we would like to show that the spectrum 
lies almost entirely within the region (1 ± yfx) 2 with high probability. 

However, the Dyson gas and Kazakov techniques 0, 6, 12. 25] that were used for k = 1 are not available for k > 1, 
which may be considered a problem of random tensor theory. The difficulty is that we have a matrix with non-i.i.d. 
entries and with unitary symmetry only within the k subsystems. Furthermore, large-deviation techniques are known 
to work only in the x ^> 1 limits. Here, Ref. [27] can prove that ||M — xl\\ < 0(y / xk log(d)) with high probability, 
which gives the right leading-order behavior only when x 3> \J k log d. (The same bound is obtained with different 
techniques by Ref. Q.) The case when x ^> 1 is handled by Ref. 0, which can bound ||M — xl\\ < 0{y/x) with high 
probability when k < 2. (We will discuss this paper further in Section HC 21 ) 

However, some new techniques will be needed to cover the case when x < 0(1). Fortunately it turns out that 
the diagrammatic techniques for k = 1 can be modified to work for general k. In Section UH we will use these 
techniques to obtain an expansion in 1/d. Second, the large deviation approach of [23| achieves a concentration 
bound of exp(— 0(de )) which needs to overcome an e-net of size exp(0(pln(l/e))). This only functions when p <C d, 
but we would like to take p nearly as large as d k . One approach when k = 2 is to use the fact that (tl)\M p ^ k\ip) 
exhibits smaller fluctuations when \tp) is more entangled, and that most states are highly entangled. This technique 
was used in an unpublished manuscript of Ambainis to prove that ||Mj, )( j,fc|| = 0(1) with high probability when 
p = 0(d 2 /polyln(c?)). However, the methods in this paper are simpler, more general and achieve stronger bounds. 

Our strategy to bound the typical value of the largest eigenvalue of M Pt d,k will be to use a trace method: we bound 
the expectation value of the trace of a high power, denoted to, of M p ^d.k- This yields an upper bound on UMp^^H 
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because of the following key inequality 

\\M p ^ k \\" n < tr(M™ d>k ). (3) 
We then proceed to expand E[trM™ d k ] (which we denote E™ dk ) as 

E™ d<k =E[tiM™ dtk \ = E E - E E d [ Sl , S2 ,...,s m ] k := E E M k (4) 

si = ls2 = l »m=l s£[p] m 

where 

E d [s| = E[tr(<p Sl <^ S2 . . .y> Sm )] , (5) 

and [p] = {1, . . . ,p}. Similarly we define E™ d k = E[trM^ k ] and E d [s\ = E [tr((/? Sl <^ S2 . . . <p Srn )], and observe that 

they obey a relation analogous to ((4]). We also define the normalized traces e™ d k = d~ k E p n d k and e™ d fe = dr k E™ d k , 
which will be useful for understanding the eigenvalue density. 

The rest of the paper presents three independent proofs that for appropriate choices of m, E™ d k = (1 + 
y/x) 2m exp(±o(m)). This will imply that E[||M P) d l fc||] < (1 + \fx) 2 ± o(l), which we can combine with standard 
measure concentration results to give tight bounds on the probability that H-Mp.^fcl is far from (1 + \fx) 2 . We will 
also derive nearly matching lower bounds on E™ d k which show us that the limiting spectral density of M Ptdjk matches 
that of the Wishart distribution (a.k.a. the k — 1 case). The reason for the multiple proofs is to introduce new 
techniques to problems in quantum information that are out of reach of the previously used tools. The large-deviation 
techniques used for the k — 1 case have had widely successful applicability to quantum information and we hope that 
the methods introduced in this paper will be useful in the further exploration of random quantum states and processes. 
Such random states, unitaries, and measurements play an important role in many area of quantum information such 
as enco ding quantum]!], classical [la, |19[, and private [281] information ove r q uantum channels, in other data-hiding 
schemes[l7|, in quantum expanders [8l 1 14| . and in general coding protocols [34], among other applications. 

The first proof, in Section [Til first uses the expectation over the Gaussian ensemble to upper-bound the expectation 
over the normalized ensemble. Next, it uses Wick's theorem to give a diagrammatic method for calculating the 
expectations. A particular class of diagrams, called rainbow diagrams, are seen to give the leading order terms. Their 
contributions to the expectation can be calculated exactly, while for m <C d 1 ^ 2k , the terms from non-rainbow diagrams 
are shown to be negligible. In fact, if we define the generating function 

G(x,y)=Y / V m ^ (6) 

m>0 

then the methods of Section [TTJ can be used to calculate ^ up to 1/d corrections. Taking the analytic continuation 
of G(x,y) gives an estimate of the eigenvalue density across the entire spectrum of M Ptd ^. More precisely, since we 
can only calculate the generating function up to 1/d corrections, we can use convergence in moments to show that 
the distribution of eigenvalues weakly converges almost surely (Corollary [5] below) to a limiting distribution. For this 
limiting distribution, for x < 1, the eigenvalue density of M Pyd ^ k vanishes for eigenvalues less than (1 — y/x) 2 . However, 
this calculation, in contrast to the calculation of the largest eigenvalue, only tells us that the fraction of eigenvalues 
outside (1 ± \fx) 2 approaches zero with high probability, and cannot rule out the existence of a small number of low 
eigenvalues. 

The second proof, in Section [TTTT is based on representation theory and combinatorics. It first repeatedly applies two 
simplification rules to E d [s\: replacing occurrences of ip 2 with ip s and replacing E[<p s ] with I/d whenever <p s appears 
only a single time in a string. Thus s is replaced by a (possibly empty) string s 1 with no repeated characters and 
with no characters occurring only a single time. To analyze E^s 1 ], we express E[iy9®™] as a sum over permutations 
and use elementary arguments to enumerate permutations with a given number of cycles. We find that the dominant 
contribution (corresponding to rainbow diagrams from Section [II]) comes from the case when s* = 0, and also analyze 
the next leading-order contribution, corresponding to s* of the form 1212, 123213, 12343214, 1234543215, etc. Thus 
we obtain an estimate for E™j k that is correct up to an o(l) additive approximation. 

The third proof, in Section II VI uses the Schwinger-Dyson equations to remove one letter at a time from the string 
s. This leads to a simple recursive formula for e p n d k that gives precise estimates. 

All three proof techniques can be used to produce explicit calculations of E r p n d k . Applying them for the first few 
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values of m yields 



E \.d,k = P 
&p,d,k - P + -jr 



(ph , 0)3 

p,d,k ~ P^ ~Jk~ + ~d2k 



E id,k = p + 3 



p 4 _ n , fi (P)a fi (p)a (p)4 fc (p)a 

- p + b^r + 5^ + ^ + ^ dfe(d + 1)fe 

+ 15-2' . M^+3£ + 6 . W> 



d fe (d+l) fe d 2fc (d+l) 2fc d k (d+l) k {d + 2) k ' 

where (p)t = p!/(p — t)! = p(p — 1) ■ • • (p — i + 1). We see that 0(1) (instead of 0(d)) terms start to appear when 
m > 4. The combinatorial significance of these will be discussed in Section UlIBI 



B. Statement of results 



Our main result is the following theorem. 
Theorem 1. Let m (x) = J2?=i N(m,£)x e , where N(m,£) = 

are known as the Narayana numbers. Then, 
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where exp(^4) := e A and the lower bound holds only when m < y/p. 
Thus, for all m > 1, k > 1, x > and p = :rd fe , 

I™ e" d . fc =/3 m (p/d fe ), 

where we have used the notation e p n d k = ^-E[tr(M™ d fe )]. 

Variants of the upper bound are proven separately in each of the next three sections, but the formulation used in 
the Theorem is proven in Section IIVI Since the lower bound is simpler to establish, we prove it only in Section IIII1 
although the techniques of Sections ITU and Hvl would also give nearly the same bound. 

For the data-hiding and correlation-locking scheme proposed in 23j, it is important that ||M|| = 1 +o(l) whenever 
x = o(l). In fact, we will show that ||M|| is very likely to be close to (1 + \/x) 2 , just as was previously known for 
Wishart matrices. First we observe that for large m, f3 m (x) is roughly (1 + yfx) 2m . 

Lemma 2. 

2^(1 + ^ (1 + V5)2T "-^ W - (1 + V5)2m (8) 
The proof is deferred to Section ITEl 

Taking m as large as possible in Theorem Q] gives us tight bounds on the typical behavior of || Mp d fc|| . 
Corollary 3. With M Pt d.k and x defined as above, 

(1 + Vx-f O < E[||M P)d , fe ||] < (1 + V^f + O (^jgp) 

and the same bounds hold with M Pt ct,k replaced by M Pt d,k- 
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Proof. A weaker version of the upper bound can be established by setting m ~ rf 1 / fc ( fc + 4 ) in 

n\\M Ptd , k \\] < E[||M p>d , fc |r]V- < d^(e™ dife )^, (9) 

where the first inequality is from the convexity of x H> x rn . In fact, the version stated here is proven in (|4"2")l at the 
end of Section HU 

The lower bound will be proven in Section HB □ 

Next, the reason we can focus our analysis on the expected value of ||M P! ,j,fc|| is because ||M Pi ,j,fc|| is extremely 
unlikely to be far from its mean. Using standard measure-concentration arguments (detailed in Section [I Ep . we can 
prove: 

Lemma 4. For any e > 0, 

Pr(|||M p , d , fc || - E[||M Mifc ||]| > e) < 2 exp(-(d - l)e 2 /k). (10) 

For any < e < 1, 

(|||M P> d,fc|| -E[PWI|]| > eE[\\M pAk \\] + 5) < 2pke~^ + 2 e - lf ^ (11) 



Pr i 

Combined with Corollary [3] we obtain: 
Corollary 5. 

Pr (|||Mp,„ lfc || - X+]\ > O (J^) + e) < 2 cxp(-de 2 /2). 

A similar, but more cumbersome, bound also exists for \\M Pj d,k\\- 

Note that for the k = 1 case, the exponent can be replaced by 0(— de 3 / 2 ), corresponding to typical fluctuations on 
the order of 0(d _2//3 ) [2l|. It is plausible that fluctuations of this size would also hold in the k > 1 case as well, but 
we do not attempt to prove that in this paper. 

Our asymptotic estimates for e p n d k also imply that the limiting spectral density of M p ^,u is given by the Marcenko- 
Pastur law, just as was previously known for the k = 1 case. Specifically, let Ai, . . . , be the non-zero eigenvalues of 
M P: d,k, with R — rankMp^fe. Generically R = min(p,d k ) and the eigenvalues are all distinct. Define the eigenvalue 
density to be 

R 

-°(a) = ^E^- a )' 

2 — 1 

then 

Corollary 6. In the limit of large d at fixed x, p(X) weakly converges almost surely to 



^+-^ (A - A -V <A<A + ) 

for any fixed k and for both the normalized and Gaussian ensembles. 

Here A± = (1 ± \/x) 2 and 7(A_ < A < A + ) = 1 if A_ < A < A + and otherwise. 

This corollary follows from Theorem Q] using standard arguments [loj. We believe, but are unable to prove, that in 
the x < 1 case, the probability of any non-zero eigenvalues existing below A_ — e vanishes for any e > in the limit 
of large d at fixed x, just as is known when k = 1. 



C. Applications 

1. Data hiding 

One of the main motivations for this paper was to analyze the proposed data-hiding and correlation-locking scheme 
of [23i | . In this section, we will briefly review their scheme and explain the applicability of our results. 
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Suppose that p = d\og c (d) for some constant c > 0, and we consider the fc-party state P = \ ELi </V We can 
think of s as a message of (1 + o(l))log<i bits that is "locked" in the shared state. In [23| it was proved that any 
LOCC (local operations and classical communication) protocol that uses a constant number of rounds cannot produce 
an output with a non-negligible amount of mutual information with s, and [23| also proved that the parties cannot 
recover a non-negligible amount of mutual information with each other that would not be revealed to an eavesdropper 
on their classical communication so that the state cannot be used to produce a secret key. (They also conjecture that 
the same bounds hold for an unlimited number of rounds.) However, if cloglog(d) + log(l/e) bits of s are revealed 
then each party is left with an unknown state from a set of ed states in d dimensions. Since these states are randomly 
chosen, it is possible for each party to correctly identify the remaining bits of s with probability 1 — O(e) [24j ]. 

On the other hand, the bounds on the eigenvalues of p established by our Corollary [5] imply that the scheme of 
Ref. [23j j can be broken by a separable-once-removed quantum measurement 1 : specifically the measurement given by 
completing {jj^y^sls into a valid POVM. We hope that our bounds will also be of use in proving their conjecture 
about LOCC distinguishability with an unbounded number of rounds. If this conjecture is established then it will 
imply a dramatic separation between the strengths of LOCC and separable-once-removed quantum operations, and 
perhaps could be strengthened to separate the strengths of LOCC and separable operations. 

2. Sampling from heavy-tailed distributions 

A second application of our result is to convex geometry. The matrix M can be thought of as the empirical 
covariance matrix of a collection of random product vectors. These random product vectors have unit norm, and the 
distribution has tp r norm on the order of iff r satisfies r < 2/k. Here the ip r norm is defined (following Q) for 

r > and for a scalar random variable X as 

\\X\\ i>r = inf{C > : E[exp(\X\/C) r ] < 2} (12) 

and for a random vector \ip) is defined in terms of its linear forms: 

IMIw = su PlK a b)llvv> 

\ a ) 

where the sup is taken over all unit vectors a. Technically, the ip r norm is not a norm for r < 1, as it does not 
satisfy the triangle inequality. To work with an actual norm, we could replace (12]) with sup t>1 E[|X|'] 1 / t / / t 1 / r , which 
similarly captures the tail dependence. We mention also that the ip2 norm has been called the subgaussian moment 
and the ipi norm the subexponential moment. 

Thm. 3.6 of Ref. Q proved that when M is a sum of vectors from a distribution with bounded norm and 
x 3> 1 then M is within 0(^/x\ogx) of xl with high probability. And as we have stated, Refs. [3, [27j can prove 
that \\M - xl\\ < 0(yJxklog(d)) with high probability, even without assumptions on r, although the bound is only 
meaningful when x ^> y/klogd. In the case when x <C 1 and 1 < r < 2 (i.e. k < 2), Thm 3.3 of Ref. Q proved 
that M is within 0(y / a;log 1 ^ r (l/a;)) of a rank-p projector. Aubrun has conjectured that their results should hold for 
r > and any distribution on ^dimensional unit vectors with ip r norm < 0(l/y/~D). If true, this would cover the 
ensembles that we consider. 

Thus, our main result bounds the spectrum of M in a setting that is both more general than that of 0, Q (since 
we allow general x > and k > 1, implying that r = 2/k can be arbitrarily close to 0) and more specific (since we 
do not consider only products of uniform random vectors, and not general ensembles with bounded ip r norm). Our 
results can be viewed as evidence in support of Aubrun's conjecture. 

D. Notation 

For the reader's convenience, we collect here the notation used throughout the paper. This section omits variables 
that are used only in the section where they are defined. 



1 This refers to a POVM (positive operator valued measure) in which all but one of the measurement operators are product operators. 
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Variable 


Definition 


d 


local dimension of each subsystem. 




k 


number of subsystems. 




P 


number of random product states chosen 




X 


p/d k . 




\<P)) 


unit vector chosen at random from C d for s = 1, . . . ,p and i = 1, 


..,k. 


\<pi) 


Gaussian vector from C d with E[(^*|^?*)] = 1. 




<p 


<^)(<y9 (for any state \tp)) 




\<Pb) 


|^i>®---®|rf) 




\<pb) 


|y;> ® • • • ® lw> 










A± 


(i±V5) 2 




E p™d,k 






v p,d,k 


^E[trM p ™J 




E d [s\ 


TP< 1" j / Ml —* / \ 

E[tv{ip Sl ■ ■ ■ tp Sm )J , where s = (si , . . . , s m ) 




G(x,y) 


V r.,"m p m 
Aum>0 il c p,d,k 




(3(x) 


E?-iN(m,l)x* 




N(m,£) 


Narayana number: i( -J (7) = JO-iX?^ 1 ) = at ^^U +li 


(and AT(0,0) = 1) 


F(x,y) 


Eo<e< m<oa N(m,iyy™ 





We also define |i/? s ), M p ,d,k, E Py d,k, G(x,y) and so on by replacing |y>*) with |<£*). 



E. Proof of large deviation bounds 

In this section we prove Lemma [21 Lemma H] and the lower bound of Corollary G3 First we review some terminology 
and basic results from large deviation theory, following Ref. [22]. Consider a set X with an associated measure 
/1 and distance metric D. If Y C X and x E X then define D(x,Y) := inf^gy D(x, y). For any e > define 
Y e := {x € X : D(x,Y) < e}. Now define the concentration function ax(e) for e > to be 

a x (e) := max{l - M (F £ ) : > 1/2}. 

Say that / : X —> R is r/-Lipschitz if |/(x) — < r]D(x,y) for any x,y £ X . If m is a median value of / (i.e. 

fj-({x : /(x) < m}) = 1/2) then we can combine these definitions to obtain the concentration result 

tx({x: f(x)>m + r)e})<a x (e). (13) 

Proposition 1.7 of Ref. [22| proves that (fT3|) also holds when we take m = 

Typically we should think of ax(e) as decreasingly exponentially with e. For example, Thm 2.3 of [22| proves that 
a i g2d-i(e) < e _ *- d— , where S 2d ~ x denotes the unit sphere in R 2d : fj, is the uniform measure and we are using the 
Euclidean distance. 

To analyze independent random choices, we define the l\ direct product X™i to be the set of n-tuples (xi, . . . , x n ) 
with distance measure -D^i((xi, . . . ,x„), (y\, . . . ,y n )) '■= D(xi,yi) + . . . + D(x n ,y n ). Similarly define Xf 2 to have 
distance measure Dp{(x\,. . . ,x„), (yx, . . .,y„)) := \J D(xi, yi) 2 + . . . + D(x n , y n ) 2 . 

Now we consider the normalized ensemble. Our random matrices are generated by taking pk independent draws 
from S 2d ~ 1 , interpreting them as elements of C d and then constructing M p ^,k from them. We will model this as the 
space ((S 2 ^ 1 )^)^. First, observe that Thm 2.4 of HH establishes that 

Next, Propositions 1.14 and 1.15 of 22] imply that 

a ((s 2d -%),\^ - 6 • 
Now we consider the map / : ((S 2d ~ 1 )^ 2 )p -» M that is defined by /({|</?*)} f =i, ...,„) = ||M Pi( j,fe||, with M Pt d,k defined 
as usual as M Pl <j,fc = 2s=i ® '" ® To analyze the Lipschitz constant of /, note that the function M — > \\M\\ 
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is 1-Lipschitz if we use the 1% norm for matrices (i.e. D(A,B) = y/tr(A — B)^(A — B)) [2(J. Next, we can use 
the triangle inequality to show that the defining map from {{S 2d ~ 1 ) T L)*i to M p ^.k is also 1-Lipschitz. Thus, / is 
1-Lipschitz. Putting this together we obtain the proof of (fTU| . 

Next, consider the Gaussian ensemble, any Gaussian vector |</3*) can be expressed as = ^/rJJ\ip l s ) , where \ip l s ) is 
a random unit vector in C d and r s ,i is distributed according to \\ d /2d. Here x\d denotes the chi-squared distribution 
with 2c? degrees of freedom; i.e. the sum of the squares of 2d independent Gaussians each with unit variance. 

The normalization factors are extremely likely to be close to 1. First, for any t < d one can compute 



Ef, 



= (1 - t/d) 



-d 



Combining this with Markov's inequality implies that Pi[r s ^ > 1 + e] = Pr[e trs i > e*( 1+e )] < (1 — t/d) d e '( 1+c ) for 
any t > 0. We will set t = de/ (1 + e) and then find that 

Pr[r S)i > 1 + e] < e -«»(<-Mi+<0) < e -*£ j ^ 

where the second inequality holds when e < 1. Similarly we can take t — —de/(l — e) to show that 

Now we use the union bound to argue that with high probability none of the r Sl i are far from 1. In particular the 
probability that any r s ^ differs from 1 by more than e/k is < 2pke~ de / 4fc . 

In the case that all the r St i are close to 1, we can then obtain the operator inequalities 



(1 - e)M Pid ,k < M Pid>k < (1 + 2e)M Pid ,k- 



(15) 



(For the upper bound we use (1 + e/fc) < e e < 1 + 2e for e < 1.) This establishes that ||M Pl d,)fe|| is concentrated 
around the expectation of E[||M Pi( j k \\], as claimed in (fTTj) . 

One application of these large deviation bounds is to prove the lower bound in Corollary[3J namely that (1 + \fx) 2 — 
O ( -Tr/m ) < E[||M Pi ,j,fc||]- First observe that Theorem [1] and Lemma [2] imply that 

(l-*£)x 
2m 2 (l + ^) 3 + " P ' d " k ' 
On the other hand, d" fe tr M < \\M\\ and so e™ d k < E[|| M pAk \\ m ]. Define ^ := E[||M p>d , fc ||]. Then 



-p,d,k 



< E[||M 



p,d 7 k | 



dAPr[||M p , d ,fe|| > A]mA m_1 

de( M + e) m - 1 Pr[||Af p ^ fe || > At + e] 



using integration by parts 



de(fi 



1 + m 



1 + m 



deexp I (m — l)e 
de exp 



k 



(d-l)e 2 
k 

k(m — 1) 
~ 2(d- 1) 



fc 2 (m- l) 2 
4(d-l) 



< 



. 2irk 
1 +m\l — — - exp 



fc 2 (m- l) 2 
4(d-l) 



from (flUt 
using 1 + e//i < 1 + e < e c 

completing the square 
performing the Gaussian integral 



Combining these bounds on e™ d k and taking the m th root we find that 

/ 



(l-f) 


a; 


2m 2 (l + Vi) 3 (l + m^j^{ exp 


( k 2 {m~l) 2 \\ 


K 4(d-l) J ) 
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Assuming that m 2 < p/2 and m 2 k 2 < d, we find that fi > A+ (l - O O 5 ^)) = A+ (l - O )) , which yields 
the lower bound on E[||A/||] stated in Corollary[3J We omit the similar, but more tedious, arguments that can be used 
to lower-bound E[|| M\\}. 

We conclude the section with the proof of Lemma [2] 

Proof. For the upper bound, note that N(m,£) < (" l ) 2 < ( 2 ™) and so 

J2N(m,£)x* < J2 (7)^ = (l + ^) 2m - 



For the lower bound, first observe that 

( 2 2 7) = 2m(2m-l)-(2m-2f+l) JP_ < u £\ 2 < ^ < 

(™) 2 m-m-(m-l)-(m-l)---(m-f+l)-(m-£ + l) (2^)! ~ (2<)! ~ 

This implies that 

AW)= ' , „ ffl'>feW. (16) 



m(m-£ + 1) V^y ~ V 2 ^ 
Next, we observe that (^i+i) — (2?) + (2^+2)' anc ^ so comparing coefficients, we see that 

(1 + v^) 3 " 



0—1 \ / 



Combining this with (|16[) completes the proof of the Lemma. □ 



II. APPROACH 1: FEYNMAN DIAGRAMS 



A. Reduction to the Gaussian ensemble 



We begin by showing how all the moments of the normalized ensemble are always upper-bounded by the moments 
of the Gaussian ensemble. A similar argument was made in 0, Appendix B]. In both cases, the principle is that 
Gaussian vectors can be thought of as normalized vectors together with some small fluctuations in their overall norm, 
and that by convexity the variability in norm can only increase the variance and other higher moments. 

Lemma 7. (a) For all p, d, k,m and all strings s£ [p] m , 

e-^E d [s\<E d [s\<E d [s\. (17) 

(b) For all p, d, k, m, 

e~^E^ k < E™ d>k < E% dtk . (18) 

Proof. First note that 

P r- 

E d[s\ = (TT / d/J,((p s ))((p ai ,tp S2 }(<p S2 ,ip S3 )...((p Sm ,tp Sl ). (19) 
\ A = Vlv*l 2 =i ' 

where the integral is over \<p a ) E C d constrained to ((p s \(p s ) = 1. 

Next, for a given choice of si,...,s m , let fx s {si, s m ) denote the number of times the letter s appears. For 
example, for Si,...,s m = 1,2,2,1,3 we have [i\ = 2,/i 2 = 2,/i 3 = 1. Then, let us introduce variables r s and use 
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J oo dr s exp(-dr s 2 /2)r^+ 2 ^- 1 I ^ = 1 to write 

E d [sx,s 2 ,...,s m ] = ([[ / ^ dfi(<p s ) / dr s e~^r 2 7J~ — j ^1(^1 ,^2)^2(^2 >¥>s 3 )-r Sm {ip Sm ,(p Sl §20) 



(II (rf+ M yS ^^ J d ^ eX P( _d l^| 2 / 2 ))^ S l'^ S =)^ s 2'^ s 3>-<^m»^i>> 

ffr— 



where the integral on the second line is over all \<p a ) € C d , with 

|&}=r.|p,>. (21) 

Then, since the integral 

P ( d \ d f 

EdW = (n (^J J dv s exp(-d\0 s \ 2 /2)y0 Sl ,ip S2 ){0 S2 ,0 S3 )^ Sm ,^ Sl ) (22) 

is positive, and 

1>TT t#^T > 7 n 1 r r>e-^, (23) 

we establish (|T7|) . 

Since E™ d k (resp. fe ) is a sum over ^[s]" 1 (resp. Ed[s\ m ), each of which is nonnegative, we also obtain ([18]) . 
This completes the proof of the lemma. □ 

From now on, we focus on this sum: 

Vp4,k= E E - E [(ll^ / d^e X p(-d|^| 2 /2))(^ 1 ,^ 2 )(^ 2 ,^ 3 )-(^ m) ^ 1 )] & (24) 

Sl =ls 2 =l s m =l s=l ^ 

We introduce a diagrammatic way of evaluating this sum. 



B. Diagrammatics 

This section now essentially follows standard techniques in field theory and random matrix theory as used in [l2j]. 
The main changes are: first, for k — 1, our diagrammatic notation will be the same as the usual "double-line" notation, 
while for k > 1 we have a different notation with multiple lines. Second, the recursion relation (|35[) is usually only 
evaluated at the fixed point where it is referred to as the the "Green's function in the large-c? approximation" (or 
more typically the large- N approximation), while we study how the number of diagrams changes as the number of 
iterations a is increased in order to verify that the sum of Eq. (1341) is convergent. Third, we only have a finite number, 
2m, of vertices, so we are able to control the corrections which are higher order in 1/d or 1/p. In contrast, Ref. [Hj], 
for example, considers Green's functions which are sums of diagrams with an arbitrary numbers of vertices. 

Integrating Eq. (|2"2"|) over S generates JT fi s \ diagrams, as shown in Fig. 1. Each diagram is built by starting with 
one incoming directed line on the left and one outgoing line on the right, with m successive pairs of vertices as shown 
in Fig. 1(a). We then join the lines coming out of the vertices vertically, joining outgoing lines with incoming lines, to 
make all possible combinations such that, whenever a pair of lines are joined between the i-th pair of vertices and the 
j-th pair of vertices, we have Sj = Sj. Finally, we join the rightmost outgoing line to the leftmost incoming line; then 
the resulting diagram forms a number of closed loops. The value of Eq. (|22[) is equal to the sum over such diagrams 
of d l ~ m , where I is the number of closed loops in the diagram. Two example diagrams with closed loops are shown in 
Fig. 1(b). 

Similarly, the sum of Eq. (|24p can also be written diagrammatically. There are k incoming lines on the left and 
k outgoing lines on the right. We have m successive pairs of vertices as shown in Fig. [Ha). Each vertex has now k 
pairs of lines connected vertically: either the solid lines in the pairs are outgoing and the dashed lines are incoming 
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b) 



FIG. 1: a) Vertices for Ed[si,Sgi\. b) Example diagrams for Ed[si,S2] with Si = S2. The diagram on the left has I = m = 2 
while the diagram on the right (which is also present for si 7^ S2) has / = 1. 




FIG. 2: a) Vertices for diagrams. The left vertex corresponds to and the right vertex corresponds to b) An example 
diagram with m — 2 and k — 2. There are Z n = 1 + 2 = 3 loops of solid lines and l p — 1 disconnected objects of dashed lines. 



or vice-versa, depending on whether the vertex has incoming solid lines on the horizontal or outgoing. We label the 
incoming solid lines by indices € [d], which we refer to as color indices, and then alternately assign to lines 

along the horizontal axis either a single index of the form s e [p] for the dashed lines, which we refer to as flavor 
indices, or k different color indices of the form £1, € [d] for the solid lines. Each of the k lines in a set of k 

parallel solid lines is also labelled by a "copy index", with the top line labelled as copy 1, the second as copy 2, and 
so on, up to copy k. 

Each of the k pairs of lines coming from a vertex is labelled with a color index £ and a flavor index s, as well as a 
copy index. The copy index on a vertical solid line is the same as the copy index of the solid line it connects to on 
the horizontal, so a given vertex has k distinct copy indices, ranging from l...k. Each diagram consists of a way of 
joining different pairs of vertical lines, subject to the rule that when we join two vertical lines, both have the same 
copy index; thus, if a given vertical line comes from the fc'-th row, 1 < k' < k, then it must join to a line which also 
comes from the fc'-th row. 

The value of a diagram is equal to d~ m times the number of possible assignments of values to the indices, such 
that whenever two lines are joined they have the same indices. The solid lines break up into some number l n different 
closed loops; again, when counting the number of closed loops, we join the solid lines leaving on the right-hand side 
of the diagram to those entering on the left-hand side of the diagram. Since all solid lines in a loop have the same 
copy index, we have l n — l n ,i + l n .2 + ... + l n ,k, where l n> y is the number of loops of solid lines with copy index 
kl . The dashed lines s come together in vertices where k different lines meet. Let l p denote the number of different 
disconnected sets of dashed lines. Then, the value of a diagram is equal to 

d- ,nk d l "p l ". (25) 

Note, we refer to disconnected sets of lines in the case of dashed lines; this is because multiple lines meet at a single 
vertex; for k = 1 these sets just become loops. An example diagram is shown in Fig.^b) for k = 2. 
Let c^j(2 n , lp) equal the number of diagrams with given l n , l p for given m, k. Then, 

KAk = E E c k m (l n ,l p )d- mk d l "p l *. (26) 
l„>x i p >i 
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a) g 3- 




FIG. 3: Iterative construction of rainbow diagrams for k = 2. The solid lines with a filled circle denotes any open rainbow 
diagram as does the dashed line with a filled circle. 




FIG. 4: (a,b) Rainbow diagrams which require two iterations for k = 1. 
C. Rainbow Diagrams 

An important set of diagrams are the so-called "rainbow diagrams" , which will be the dominant contributions to 
the sum (|26[) . We define these rainbow diagrams with the following iterative construction. 

We define a group of k solid lines or a single dashed line to be an open rainbow diagram as shown in Fig. EJa). We 
also define any diagram which can be contructed as in Fig. |3]Jb,c) to be a open rainbow diagram, where the k solid 
lines or one dashed line with a filled circle may be replaced by any open rainbow diagram. We say that the rainbow 
diagrams in Fig. [3jb,c) has solid and dashed external lines respectively. 

In general all open rainbow diagrams can be constructed from the iterative process described in Fig. [3jb,c), with 
one "iteration" consisting of replacing one of the filled circles in Fig. [3](b,c) with one of the diagrams in Fig. [3] The 
diagrams in Fig. 0(a) require zero iterations, and each iteration adds one vertex. For example, in Fig. 4(a,b) we show 
the two diagrams with solid external lines which require two iterations to construct for k = 1. We define a rainbow 
diagram to be any open rainbow diagram where we assume that the right outgoing edge and left incoming edge are 
solid lines and are connected. 



D. Combinatorics of Diagrams and Number of Loops 

We now go through several claims about the various diagrams. The goal will be to count the number of diagrams 
for given l n ,l p . First, we claim that for the rainbow diagrams 

l n + kip = (m + l)fc, (27) 

as may be directly verified from the construction. Next, we claim that for any diagram 

l n + kl P < (m + l)k. (28) 

From Eq. ([271 the rainbow diagrams saturate this bound (|28p . We claim that it suffices to show Eq. (l28l) for k = 1 
in order to show Eq. (|2"5)l for all k. To see this, consider any diagram for k > 1. Without loss of generality, suppose 
In.i > In.k' for all 1 < k' < k. Then, l n + kl p < k(l n: i +p). We then remove all the solid lines on the horizontal with 
copy indices 2...k, as well as all pairs of lines coming from a vertex with copy indices 2...k. Having done this, both 
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the solid and the dashed lines form closed loops, since only two dashed lines meet at each vertex. The new diagram 
is a diagram with k = 1. The number of loops of solid lines is l n ±, while the number of loops of dashed lines in the 
new diagram, l' p , is greater than or equal to l p since we have removed dashed lines from the diagram. Thus, if we can 
show Eq. (|2"8j) for k = 1, it will follow that l nj \ + l p < (m + 1) and so l n + kl p < (m + l)k. 

To show Eq. (l28l) for k = 1, we take the given diagram, and make the replacement as shown between the left and 
right half of Fig. 5(a): first we straighten the diagram out as shown in the middle of Fig. 5(a), then we replace the 
double line by a wavy line connected the solid and dashed lines. Finally, we take the point where the solid line leaves 
the right-hand side of the diagram and connects to the solid line entering the left-hand side and put a single dot on 
this point for reference later as shown in Fig. 5(b,c). Having done this, the diagram consists of closed loops of solid or 
dashed lines, with wavy lines that connect solid to dashed lines, and with one of the closed loops of solid lines having 
a dot on it at one point. 

This procedure gives an injective mapping from diagrams written as in Fig. 2 to diagrams written as in Fig. 5. 
However, this mapping is not invertible; when we undo the procedure of Fig. 5(a), we find that some diagrams can 
only be written as in Fig. 2 if there are two or more horizontal lines. The diagrams which are the result of applying 
this procedure to a diagram as in Fig. 2 with only one horizontal line are those that are referred to in field theory as 
contributions to the "quenched average," while the sum of all diagrams, including those not in the quenched average, 
is referred to as the "annealed average" . To determine if a diagram is a contribution to the quenched average, start at 
the dot and then follow the line in the direction of the arrow, crossing along a wavy line every time it is encountered, 
and continuing to follow solid and dashed lines in the direction of the arrow, and continuing to cross every wavy 
line encountered. Then, a diagram is a contribution to the quenched average if and only if following the lines in this 
manner causes one to traverse the entire diagram before returning to the starting point, while traversing wavy lines in 
both directions. As an example, consider the diagram of Fig. 5(c): this diagram is not a contribution to the quenched 
average, as can be seen by traversing the diagram, or by re-drawing the diagram as in Fig. 5(d) which requires two 
horizontal solid lines 2 . If a diagram is a contribution to the quenched average, then traversing the diagram in this 
order (following solid, dashed, and wavy lines as above) corresponds to traversing the diagram writen as in Fig. 2 
from left to right. 

Since all diagrams are positive, we can bound the sum of diagrams which are contributions to the quenched average 
by bounding the sum of all diagrams as in Fig. 5. The number of wavy lines is equal to m. The diagram is connected 
so therefore the number of solid plus dashed loops, which is equal to l ni i + I', is at most equal to the number of 
wavy lines plus one. Therefore, Eq. (|28p follows. From this construction, the way to saturate Eq. (|2"8)> is to make a 
diagram which is a tree whose nodes are closed loops of dashed and solid lines and whose edges are wavy lines; that 
is, a diagram such that the removal of any wavy line breaks the diagram into two disconnected pieces. These trees 
are the same as the rainbow diagrams above. In Fig. 5(b) we show the two different trees which correspond to the 
rainbow diagrams of Fig. 4. 

Next, we consider the diagrams which are not rainbow diagrams. First, we consider the case k = 1. Let d — 
m + 1 — l n — l p > 0. If d > 0, then the diagram is not a rainbow diagram. However, if d > 0, using the construction 
above with closed loops connected by wavy lines, there are only l n + l p loops connected by more than l n + l p — 1 
wavy lines; this implies that the diagram is not a tree (using the notation of Fig. 5) or a rainbow diagram (using the 
notation of Fig. 4), and hence it is possible to remove d different lines and arrive at a diagram which is a rainbow 
diagram. Thus, all diagrams with 2m vertices and d > can be formed by taking rainbow diagrams with 2m — d 
vertices and adding d wavy lines; these wavy lines can be added in at most [m(m — l)] d different ways. Thus, for 
k = 1 we have 

m + l-l n -l p = d>0-> c l m {l n , l p ) < c 1 m _ d {lnA P )m 2d (29) 

We now consider the number of diagrams which are not rainbow diagrams for k > 1. We consider all diagrams, 
including those which contribute to the annealed average, but we write the diagrams as in Fig. 2, possibly using 
multiple horizontal lines. Consider first a restricted class of diagrams: those diagrams for which, for every vertex with 
k pairs of lines leaving the vertex, all k of those pairs of lines connect with pairs of lines at the same vertex. This is 
not the case for, for example, the diagram of Fig. &h), where of the two pairs of lines leaving the leftmost vertex, 
the top pair reconnects at the second vertex from the left, while the bottom pair reconnects at the rightmost vertex. 
However, for a diagram in this restricted class, the counting of diagrams is exactly the same as in the case k = 1, 
since the diagrams in this restricted class are in one-to-one correspondence with those for k = 1. So, the number of 



2 Such annealed diagrams are contributions to the average of the product of two (or more) traces of powers of M Pt d,k- 
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FIG. 5: (a) Deformation of diagram, (b) Deformation of diagrams in Fig. 4(a,b). (c) Example of a diagram which contributes 
to the annealed average but not the quenched average, (d) Same diagram as in (c). 

diagrams in this restricted class, r , obeys 

(to + l)k - l n - kl p = d > -> c k m Jl n , y < c k m _ dtr {l n , l p )[m(m - l)] d / k (30) 

Now, we consider a diagram which is not in this restricted class. Locate any vertex with incoming solid lines 
on the horizontal and an outgoing dashed line on the horizontal, such that not all pairs of lines leaving this vertex 
reconnect at the same vertex. Call this vertex v\ . Then, find any other vertex to which a pair of lines leaving vertex vi 
reconnects. Call this vertex vi. Let there be / pairs of lines leaving vertex v\ which do not conenct to v%, and similarly 
I pairs of lines entering V2 which do not come from v\, with 1 < I < k — 1. Label these pairs of lines L\, L\, L\ and 
L\ , L|, L\, respectively. Let these lines connect to pairs of lines M\, M\, M\ and M-j 2 , M| , M| respectively. 
Let 113 be the vertex just to the right of vi, so that the dashed line entering v\ comes from V3, and similarly let V4 
be the vertex just to the left of 1)2, so that the dashed line leaving V2 goes into U4, as shown in Fig. |U(a). Then, we 
determine if there is a way to re-connect pairs of lines so that now L\, connects to Lf, and Mh connects to Mf, for all /' 
in some subset of {1, /} such that the diagram splits into exactly two disconnected pieces. If there is, then we find 
the smallest subset of {1, 1} with this property (making an arbitrary choice if there is more than one such subset) 
and make those reconnections. Let Vi, V2 denote the two disconnected subsets of vertices after the reconnections. By 
making these reconnections, then, we are reconnecting precisely the pairs of lines which originally connected vertices 
in set Vi to those in V2; if there are l c such lines, then we increase l n by l c > 1. Thus, we increase l p by one and also 
increases l n by at least 1. We then modify the diagram to rejoin the two pieces: the dashed line leaving to the right 
of vertex v± connects to it some vertex w\ in the same piece, and there is some other dashed line in the other piece 
which connects two vertices v[ , w'x ; we re-connect these dashed lines so that v\ connects to w[ and v[ connects to 
W±. This reduces l p by 1 back to its original value and makes the diagram connected. Thus, we succeed in increasing 
l n + klp — mk by at least 1. 

On the other hand, if no such subset exists, we re-connect all pairs of lines for all 1 < I' < I, as shown in Fig. [fjb). 
The resulting diagram must be connected (if not, then there would have been a subset of lines which could be re- 
connected to split the line into exactly two disconnected pieces). Then, there are two cases: the first case is when the 
dashed line leaving V2 does not connect to v\ (so that vi 7^ W3 and v± ^ V4) and it is possible to re-connect the dashed 
lines joining v± to V3 and V2 to V4 so that now V2 is connected to v\ and W3 is connected to U4 without breaking the 
diagram into two disconnected pieces. In this first case, we then also make this re-connection of dashed lines, which 
increases l p by one, while keeping the diagram connected. However, in this case, the initial re-connection of pairs of 
lines may have reduced l n by at most I. Thus, in this case kl p + l n — mk is increased by at least 1. The second case is 
when cither V2 connects to v\ already or it is not possible to make the re-connection of dashed lines without splitting 
the diagram into two pieces. This is the case in Fig.[5Jb). In this case, however, l n must have increased by at least 1 
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FIG. 6: (a) Diagram of Fig. [2jb) with vertices vi,V2,V3,V4 marked, for a particular choice of vi,V4. (b) Result of applying 
re-connection procedure to diagram. 

by the initial re-connection of pairs of lines 3 and thus again we increase kl p + l n — mk by at least 1. 

Repeating this procedure, we ultimately arrive at a diagram in the restricted class above. At each step, we succeed 
in reducing d — (m + l)k — l n — kl p by at least unity, either by increasing l n by at least 1 and l p by 2, or by 
increasing l p by 1 and reducing l n by at most k — 1. Given a diagram in the restricted class, we can further reduce d 
following Eq. pop. Then, any diagram can be found by starting with a diagram in the restricted class and undoing 
this procedure; at each step in undoing the procedure we have at most m 2 (m— l) 2 (k-i) choices (there are at most m 2 
choices for vi, V2, and then we must re-connect at most 2(k — 1) pairs of lines). Thus, for (m + l)k — l n — kl p = d > 
we have 

c k m (l n ,l p ) < m 2k c h m (l n + l,l p ) (31) 
+m 2k c k n {l n -k + 1,/p + l) 
+m 2 c k n _ 1 (l n , l p )- 

This implies that for d > 0, 

E 

with 

m 2k m 2k d k ~ 1 m 2 , , x m 2k m 2 , N 



E. Bound on Number of Rainbow Diagrams 

Finally, we provide a bound on the number of rainbow diagrams. Let us dehne S®(l n , l P ) to equal to the number of 
open rainbow diagrams with solid lines at the end, with v vertices, l n loops of solid lines (not counting the loop that 
would be formed by connected the open ends), and l p disconnected sets of dashed lines, which may be constructed 
by at most a iterations of the process shown in Fig. |3 Similarly, define D%(l n ,l p ) to equal to the number of open 
rainbow diagrams with dashed lines at the end, with v vertices, l n loops of solid lines (not counting the loop that 
would be formed by connected the open ends), and l p disconnected sets of dashed lines, which may be constructed 
by at most a iterations of the process shown in Fig. [31 These open rainbow diagrams obey l n /k + l p = m. Define the 



To see why l n must have been increased by at least one when reconnecting pairs of lines, in the case where making the reconnection of 
the dashed line would split the diagram into two disconnected pieces, let Vi,V2 denote the vertices in these two disconnected pieces. 
Then, by reconnecting the pairs of lines, there are no longer any solid lines joining Vi to V2, so Z n increases by /' > 1. 



-d l n +l p =m+l-(d-l) 

c k m (l n ,l p )d l " P l - < S c k n (l n ,l p )d l -p l - 



(32) 
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generating function 4 

Gi a \z,d, P ) = ^^^z-^r^dVs;^,/^ (34) 

V l n lp 

G d a) (z,d,p) = ^^^z-/ 2 d-» fc / 2 ( i i » P ''fl;(u P ). 

v l„ lp 

Then, we have the recursion relations, which come from Fig. [3](b,c) : 

Gi a) (z,d, P ) = 1 + z- 1 xG ( d a ^ 1 \z,d,p)G{ a - 1) (z,d,p), (35) 
G d a) (z,d,p) = l + z- 1 Gi a - 1 \z,d,p)G { d a - 1) (z,d :P ). 

First, consider the case x < 1. From Eq. (|35"|) , G d a \z 1 d 1 p) = 1 + (Gi a \z,d,p) — l)/x for all a, so that we have 
the recursion G { s a \z,d,p) = 1 + z^xG^ (z, d,p)(l + (G{ a ~ 1} (z,d,p) - l)/x) = 1 + z -\x - l)G { ^ 1] (z, d,p) + 
z~ 1 Gi a 1 ^(z,<i,p) 2 . The fixed points of this recursion relation are given by 



G s {z,d,p) = — . (36) 



Define 

^o=( 1 |;_^f )' 1 = (l + v^) 2 - (37) 
Then, for z > z , Eq. (|35l) has two real fixed points, while at z = z , Eq. ()35l) has a single fixed point at 

G s (z ,d,p) = ^[l + Zo\l-xj] = l + >/i=v^>l. (38) 

Since G^ {z,d,p) = G d °\z,d,p) — 1 which is smaller than the fixed point, we find that G'f'\z,d 1 p) increases 
montonically with a and remains bounded above by G s {z, d,p). All rainbow diagrams with 2m vertices can be found 
after a finite number (at most m) iterations of Fig. |3jb,c) so 

In+lp— m+1 

c k m {l n ,l p )d~ mk d l "p l * <pz™G s (z ,d, P ). (39) 

Alternately, if x > 1, we use G{ a \z,d,p) = 1 + {G d a \z,d,p) — l)ir, to get the recursion G d a \z,d,p) = 1 + 

z^G^z, d,p)(l + {G d a) (z, d,p) - l)x) = 1 + z~\l - x)G d a - 1] (z, d,p) + z- i xG^~ 1 \z, d,p) 2 . Then, again for z = z 

this recursion has a single fixed point and Gi a \z,d,p) increases monotonically with a and remains bounded by 
G s (z ,d,p). 

F. Sum of All Diagrams 

We now bound the sum of all diagrams (|26[) using the bound on the sum of rainbow diagrams (|39[) and Eq. (|32[) . 

(„+Z p =m+l— j 

J2 E c k m (l n ,l p )d- mk d l "p l ? < pz™G s (z ,d,p)J25 3 - (40) 

j>o l„,l p j>a 



Then, if d < 1 we have 



E^ k < J^-^GsMp) = j^Zo H (41) 



4 The limit as a — ► oo of this generating functional is equal to, up to a factor 1/z in front, the Green's function in the large-d limit usually 
defined in field theory. 
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We can pick m of order d 1 / 2k and still have 5 < 1/2. Then we can use EfllMp^kH] < (E™ d fc )^ m to bound 



E[\\M p , d , k \\] < (1 + V^f ■ exp ( ln( - 2p ^ ) 

= (1 + ^ + o(ii*2), 

V « 2fc / 



(42) 



as claimed in Corollary[3l We are assuming in the 0() notation in this bound that x — 0(1). 



III. APPROACH 2: COMBINATORICS AND REPRESENTATION THEORY 



This section gives a second proof of Theorem [T] that uses facts about symmetric subspaces along with elementary 
combinatorics. The fundamentals of the proof resemble those of the last section in many ways, which we will discuss 
at the end of this section. However, the route taken is quite different, and this approach also suggests different possible 
extensions. 

Recall that we would like to estimate 



Our strategy will be to repeatedly reduce the string s to simpler forms. Below we will describe two simple methods 
for reducing s into a possibly shorter string R(s) such that Ed[s\ equals Ed[R(s)], up to a possible multiplicative 
factor of 1/d to some power. Next we will consider two important special cases. First are the completely reducible 
strings: s for which the reduced string R(s) is the empty string. These are analogous to the rainbow diagrams in 
Section [IT] and their contribution can be calculated exactly (in Section IIII A[) . The second special case is when s is 
irreducible, meaning that R(s) = s; that is, neither simplification steps can be applied to s. These strings are harder 
to analyze, but fortunately make a smaller contribution to the final sum. In Section IIII B( we use representation 
theory to give upper bounds for Ed[s\ for irreducible strings s, and thereby to bound the overall contribution from 
irreducible strings. Finally, we can describe a general string as an irreducible string punctuated with some number 
of repeated letters (defined below) and completely reducible strings. The overall sum can then be bounded using a 
number of methods; we will choose to use a generating function approach, but inductively verifying the final answer 
would also be straightforward. 

Reducing the string: Recall that E d [s\ — tr(p Sl ■ ■ ■ f Sm , where each \ip s ) is a unit vector randomly chosen from C d . 
We will use the following two reductions to simplify s. 

1. Remove repeats. Since ip a is a pure state, Lp\ — tp a and we can replace every instance of aa with a in s without 
changing £7<i[s]. Repeatedly applying this means that if Si — Si + \ = ■■■ = Sj, then Ed[s\ is unchanged by 
deleting positions i + 1, . . . ,j. Here we identify position i with m + i for all i, so that repeats can wrap around 
the end of the string: e.g. the string 11332221 would become 321. 

2. Remove unique letters. Since E[y> a ] = I/d for any a, we can replace any letters which appear only once with 
I Id. Thus, if Si =t Sj for all j ^ i then Ed[s\ = Ed[s']/d, where s 1 € [p] m_1 is obtained from s by deleting 
the position i. Repeating this process results in a string where every letter appears at least twice and with a 
multiplicative factor of 1/d for each letter that has been removed. Sometimes the resulting string will be empty, 
in which case we say Ed[%] =til= d. Thus for strings of length one, Ed[a) = Ed[$]/d — djd = 1. 

We will repeatedly apply these two simplification steps until no further simplifications are possible. Let R(s) denote 
the resulting (possibly empty) string. Recall from above that when Ris) = 0, we say s is completely reducible, and 
when R{s) — s, we say s is irreducible. The sums over these two special cases are described by the following two 
Lemmas. 



El 



'p,d,k 



via 



se[ P ] 



Lemma 8. 




(43) 



se[p] m 

i?(sO=0 
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We will prove this Lemma and discuss its significance in Section UlI Al It will turn out that the completely reducible 
strings make up the dominant contribution to E™ d k when m is not too large. Since (|43l) is nearly independent of 
k (once we fix x and p), this means that E™ d k is also nearly independent of k. It remains only to show that the 
sub-leading order terms do not grow too quickly with k. Note that this Lemma establishes the lower bound of 
Theorem [TJ 

For the irreducible strings we are no longer able to give an exact expression. However, when to is sufficiently small 
relative to d and p, we have the following nearly tight bounds. 

Lemma 9. If m < min(d k / 6 /2 1+k / 2 , (p/5000) 2 ^ ) then 



E d [sf < -. v x^ (44) 

L J — M _ 5000m 2fc + 12 \ l-i _ 2 2 + k rn 2 \ V ' 

v p A A ) 

m 2 

Additionally, when to is even, the left-hand side of H44\ ) * s > x^~e~~ . 

The proof is in Section HlIB I Observe that when to € o(d k ^ 6 ) n o(p 2k + 12 ) and to is even, we bound the sum on the 
LHS of (|33]) by (1 ± o(l))a;™ 1 / 2 . We also mention that there is no factor of l/d k on the LHS, so that when x = 0(1) 
and to satisfies the above condition, the contribution from irreducible strings is a 0{l/d k ) fraction of the contribution 
from completely reducible strings. 

Next, we combine the above two Lemmas to bound all strings that are not covered by Lemma [8] 

Lemma 10. If m < mm(d k ^ 6 /2 1+fe / 2 , (p/5000)^ri2 ) then 



E d [sf<-, ^toA™ +2 . (45) 

The proof is in Section IIII CI 

To simplify the prefactor in (1431) . we assume that to < min(2d 1 /VM fe/6 / 22+fe/2 , (p/5000) 1 ^+T5/2), so that the 

RHS of (1431) becomes simply < 12toA" 1+2 . By Lemma [5J this is < 24 ™ A+ j3 m {x). Then we combine Lemma [S] and 
Lemma ITOl to obtain the bound 



24m 3 A 2 

W <(1+ zr ^)p m {x) (46) 



which is a variant of the upper-bound in Theorem [TJ It is tighter than (JT]), but holds for a more restricted set of to. 
If we express the upper bound in terms of A™ then we can skip Lemma [S] and obtain simply 



12rWA+ 



Sp,d,k < I 1+ ^-^ A™. (47) 



A. Completely reducible strings 

We begin by reviewing some facts about Narayana numbers from [30L [3l1 | . The Narayana number 

» T / «s 1 / TO A / toA 1 / TO A /to — 1 A ,,„ N 

^ = mO-l)W = 70-l)Ul) (48) 

counts the number of valid bracketings of to pairs of parentheses in which the sequence () appears £ times. A 
straightforward combinatorial proof of (|48l) is in [3(|. When we sum (|48p over I (e.g. if we set x = 1 in (|4"5|) ) then we 
obtain the familiar Catalan numbers —^tt ( 2m ) . 

m+l V m J 

We can now prove Lemma [H The combinatorial techniques behind the Lemma have been observed before [30l l3l|. 
and have been applied to the Wishart distribution in [l(], EH . 

Proof: For a string s such that R(s) — 0, let I be the number of distinct letters in s. In the process of reducing s to 
the empty string we will ultimately remove £ unique letters, so that Ed[s\ k = d k ( 1 ~ e \ It remains now only to count 
the number of different s that sastify R(s) = and have £ distinct letters. 
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Suppose the distinct letters in s are Si, S2, ■ ■ ■ , Se € [p] . We order them so that the first occurrence of Si is earlier 
than the first occurrence of Si + i for each i. Let a be the string obtained from s by replacing each instance of Si 
with i. Then a has the first occurrences of 1,2, ... ,£ appearing in increasing order and still satisfies R{a) — and 
Ed[v] k = d k ( x ~ e \ Also, for each a, there are p\/(p — £)\ < p e corresponding s. 

It remains only to count the number of distinct a for a given choice of m and £. We claim that this number is given 
by N(m, £). Given a, define ai to be the location of the first occurrence of the letter i for i = 1, . . . Observe that 

1 = a 1 < a 2 < • • • < < m. (49) 
Next, define \ii to be the total number of occurrences of i in er, and define bi = fJ-j for i = 1, . . . Then 

1 < h < 6 2 < • • • < h = m (50) 

Finally, we have 

cii < bi for each i = 1, . . . , £. (51) 

Ref. [3l| proved that the number of (ax, 61), . . . , {ae,bg) satisfying (|4"9")l . ([50)1 and (l5"Tj) is N(m,t). Thus, we need 
only prove that a is uniquely determined by (ai, b\) 1 . . . , (ae, be). The algorithm for finding a is as follows. 

For t = 1, . . . , m. 

If t = di then set s := i. 

Set at := s. 

Set fi s := (i s - 1. 

While (n s = 0) set s := s - 1. 



In other words, we start by placing l's until we reach ai. Then we start placing 2's until we've either placed \xi 2's, 
in which case we go back to placing l's; or we've reached 03, in which we case we start placing 3's. The general rule 
is that we keep placing the same letter until we either encounter the next or we run out of the letter we were using, 
in which case we go back to the last letter we placed. 

To show that a couldn't be constructed in any other way, first note that we have a ai = i for each i by definition. 
Now fix an i and examine the interval between <Zj and a,_|_i. Since it is before dj+i, it must contain only letters in 
{1, . . . Using the fact that R{cr) — 0, we know that a cannot contain the subsequence j-i-j-i (i.e. cannot be of 
the form • • • j ■ ■ ■ i ■ ■ ■ j ■ ■ ■ i). We now consider two cases. 

Case (1) is that \Xi > a^+i — a^. In this case we must have at = i whenever ai < t < a^+i. Otherwise, this would 
mean that some sS{l,...,i — 1} appears in this interval, and since s must have appeared earlier as well (s < i so 
a s < ai and a aa = s), then no «'s can appear later in the string. However, this contradicts the fact that \ii > ai + \ — ai. 
Thus if fii > ai + \ — ai then the entire interval between ai and a^+i must contain i's. 

Case (2) is that /ii < a^+i — a.;. This means that there exists t with a.; < t < a^+i and a t G {1, . . . , i — 1}; if there 
is more than one then take t to be the lowest (i.e. earliest). Note that a t > ^ i for all t' > t; otherwise we would have 
a a t -i-at~i subsequence. Also, by definition ov = i for <t' < t. Since this is the only place where i appears in the 
string, we must have t = ai + fii. Once we have placed all of the i's, we can proceed inductively to fill the rest of the 
interval with letters from {1, . . . ,i — 1}. 

In both cases, a is uniquely determined by a±, . . . , an and b\, . . . ,b# (or equivalently, /ii, . . . , \ig ). This completes 
the proof of the equality in (14U)) . □ 

Before continuing, we will mention some facts about Narayana numbers that will later be useful. Like the Catalan 
numbers, the Narayana numbers have a simple generating function; however, since they have two parameters the 
generating function has two variables. If we define 

F(x,y)= J2 N(m,£)x e y m , (52) 

0<l<m<oo 



then one can show|30l l31| (but note that [30| takes the sum over m > 1) that 



F(,,,)^ 1 + ( 1 -^-V /1 - 2 ( 1 + ^ + ( 1 --^. (53) 



We include a proof for convenience. First, by convention iV(0, 0) = 1. Next, an arrangement of m pairs of parentheses 
can start either with () or ((. Starting with () leaves N(m — 1,^—1) ways to complete the string. If the string starts 
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with ( ( then suppose the ) paired with the first ( is the i th ) in the string. We know that 2 < i < m and that the 
first 2i characters must contain exactly i fs and i )'s. Additionally, the 2i — 1 st and 2i th characters must both be /s. 
Let j be the number of appearances of () amongst these first 2i characters. Note that j < min(i — 1,1), and that () 
appears t — i times in the last 2m — 2i characters. Thus there are 

m min(i— rn min(i— 1,£) 

N(i-l,j)N(m-i,e-j) = -N(m-l,e) + Y^ ^ N{i- l,j)N(m- i,£- j) 

i=2 j=l i=l j=l 

ways to complete a string starting with ( (. Together, these imply that 

m min(i — 1,1) 

N(m,£)=N(m-l,£-l)-N(m-l,£)+J2 Y N{i- l,j)N(m- j), (54) 

t=i i=i 

which we can state equivalently as an identify for the generating function (|52)) : 

F = l + xyF + y{F 2 -F), (55) 

which has the solution (|55|) . (The sign in front of the square root can be established from 1 = N(0, 0) = F(x, 0).) 

Connection to Sectioning Observe that (|53[) matches (|36[) once we make the substitution y = z . Indeed it can 
be shown that rainbow diagrams have a one-to-one correspondence with valid arrangements of parentheses, and thus 
can be enumerated by the Narayana numbers in the same way. 

Connection to free probability: Another set counted by the Narayana numbers is the set of noncrossing partitions 
of [m] into I parts. The non-crossing condition means that we never have a < b < c < d with a, c in one part of 
the partition and b, d in another; it is directly analogous to the property that a contains no subsequence of the form 
j-i-j-i- 

To appreciate the significance of this, we return to the classical problem of throwing p balls into d bins. The 
occupancy of a single bin is z = Z\ + . . . + z p where z\, . . . , z p are i.i.d. and have Pr[z^ = 0] = 1 — l/d, Pr[z^ = 1] = 1/d. 
One can readily verify that 

E[z m ]=£|Par(m,^)|^, 

e=i 

where Par(m, €) is the set of (unrestricted) partitions of m into £ parts. 

This is an example of a more general phenomenon in which convolution of classical random variables involves 
partitions the same way that convolution of free random variables involves non-crossing partitions. See Ref. for 
more details. 



B. Irreducible strings 

As with the completely reducible strings, we will break up the sum based on the powers of p and d which appear. 
However, while in the last section p and l/d k both depended on the single parameter £, here we will find that some 
terms are smaller by powers of 1/p and/or 1/d. Our strategy will be to identify three parameters — £, C2, and /t2, all 
defined below — for which the leading contribution occurs when all three equal m/2. We show that this contribution is 
proportional to \/x m and that all other values of £, C2, and jj,2 make negligible contributions whenever m is sufficiently 
small. 

Again, we will let £ denote the number of unique letters in s. We will also let Si , . . . , Si € [p] denote these unique 
letters. However, we choose them so that Si < S2 < • • • < Se, which can be done in 

© <- i <*> 

ways. Again, we let a £ [£] m be the string that results from replacing all the instances of Si in s with i. However, 
because of our different choice of Si, ... , Sg , we no longer guarantee anything about the ordering of 1, . . . ,t in a '. 
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We will also take fx a be the frequency of a in a for each a = 1, . . . , £. We also define fa to be the number of a such 
that fj, a = b. Observe that 



£ = (57) 

b 

m = >^Ma = /^fa. (58) 

a=l 6 

Also recall that since R{3) = a, a has no repeats or unique letters. Thus \i a > 2 for each a, or equivalently fa = 0. 
This also implies that £ < to/2. Since (|56|) is maximised when £ = |_ttJ > we win focus on this case first and then show 
that other values of £ have smaller contributions. Moreover (j58| implies that fa < £ and ([57]) . (|58|) and the fact that 
fa — imply that //2 > 3£ — m. Together we have 

3£ - to < /* 2 < £. (59) 

Thus £ is close to m/2 if and only if fa is as well. This will be useful because strings will be easier to analyze when 
almost all letters occur exactly twice. 

We now turn to the estimation of Ed[a]. To analyze -E^p] = E[tr <^ CT1 <^ CT2 • • • <£><t„J, we first introduce the cyclic shift 
operator 

C m = \ii, . . . ,i m )(i 2l ■ ■ ■ ,i m ,ii\- 

ii,...,i m £[d] 

Then we use the identity 

tr[<£ CTl </v 2 • ■ ■ <p„ m ] = tr[C m (tp ai <g> <p a2 ® • • • ® </5 CTm )]. (60) 
Next, we take the expectation. It is a well-known consequence of Schur-Weyl duality (see e.g. Lemma 1.7 of |ll|) that 

E ^'l " ^ + i^/ + ,-d - < M > 

We will apply this to (|60|) by inserting (|6ip in the appropriate locations as given by a. Let iS,y := {tt G <S m : cr; = 
G be the set of permutations that leaves a (or equivalently s) invariant. Then \S&\ = /ii! ■ ■ ■ and 

E d [a] = E[trC m (^ CTl ® <^ CT2 ® • • • ® ^J] (62a) 

= tr C m — e (62b) 

nf =1 d(d+i)---(d+Mi-i) 

<trC m E ; g5g7r (62c) 



(62d) 



= ^ d cyc(C m 7r)-m^ (g 2e ) 

This last equality follows from the fact that for any permutation v acting on (C d )® m , we have that 

trv = d cyc{v \ (63) 

where cyc{v) is the number of cycles of v. (Eq. (1631) can be proven by first considering the case when cyc(^) = 1 and 
then decomposing a general permutation into a tensor product of cyclic permutations.) 

To study cyc(C m 7r), we introduce a graphical notation for strings. For any string cr, define the letter graph G to 
be a directed graph with £ vertices such that for i = !,...,£, vertex i has in-degree and out-degree both equal to 
fii. (For brevity, we will simply say that i has degree /ij.) Thus there are a total of to edges. The edges leaving and 
entering vertex i will also be ordered. To construct the edges in G, we add an edge from s, to s i+1 for i = 1, . . . , to, 
with s m +i := 8\. The ordering on these edges is given by the order we add them in. That is, if letter a appears in 
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positions ii, 12, • • • with i\ < 12 < ■ ■ ■ , then the first edge out of a is directed at s^+i, the second out-edge points at 
Si 2 +i, and so on. Likewise, a's incoming edges (in order) come from s^-i, Sj 2 -i, . . .. 

Now we think of the incoming and outgoing edges of a vertex as linked, so that if we enter on the j th incoming 
edge of a vertex, we also exit on the j th outgoing edge. This immediately specifies a cycle through some or all of G. 
If we use the ordering specified in the last paragraph then the cycle is in fact an Eulerian cycle (i.e. visits each edge 
exactly once) that visits the vertices in the order s\ 1 S2, ■ ■ ■ , s m . Thus, from a letter graph G and a starting vertex we 
can reconstruct the string a that was used to generate G. 

The letter graph of a can also be used to give a cycle decomposition of C m 7r. Any permutation tt € can be 
thought of as permuting the mapping between in-edges and out-edges for each vertex. The resulting number of edge- 
disjoint cycles is exactly cyc(C m 7r). To see this, observe that tt maps i\ to some 12 for which — <Ji 2 and then C m 
maps 12 to %2 + 1. In G these two steps simply correspond to following one of the edges out of i\. Following the path 
(or the permutation) until it repeats itself, we see that cycles in G are equivalent to cycles in C m 7r. 

We now use letter graphs to estimate (j6"2")l . While methods for exactly enumerating cycle decompositions of directed 
graphs do exist j?}, for our purposes a crude upper bound will suffice. Observe that because a contains no repeats, 
G contains no 1-cycles. Thus, the shortest cycles in G (or equivalcntly, in C m 7r) have length 2. Let C2(ir) denote 
the number of 2-cycles in C m 7r and c™ ax = max T6 5 ; 02(71"). Sometimes we simply write C2 instead of 02(77) when the 
argument is understood from context. We now observe that C2 obeys bounds analogous to those in In particular, 

c max < &nc j f Qr &ny ^ 

cyc(C m 7r) < c 2 (7r) H - = - . (64) 

Since 02(77) < c™ ax < m/2, (f64|) implies that cyc(C m 7r) < to/2. Thus the smallest power of 1/d possible in (|62"T) is 
Y- When we combine this with (j5§)) . we see that the leading-order contribution (in terms of p and d) is 0(x m ^ 2 ), 
and that other terms are smaller by powers of 1/p and/or 1/d. Additionally, this leading-order contribution will have 
a particularly simple combinatorial factor. 

The leading-order term. Consider the case when m is even and I = = c 2 na * = This corresponds to a graph 
with £ vertices, each with in-degree and out-dcgrcc two. Additionally, there is an ordering of the edges which organizes 
them into £ 2-cycles. Thus every vertex participates in exactly two 2-cycles. Since the graph is connected, it must 
take the form of a single doubly-linked loop. Thus the letter graph of the leading-order term is essentially unique. See 
Fig. [8] for an example when to = 10. The only freedom here is the ordering of the vertices, which can be performed 
in £\ ways. Together with (|56[) . this means the combinatorial contribution is simply ^!(^) < p l ■ 

Now we examine the sum in (1621) . Assume without loss of generality that the vertices 1,...,£ are connected in the 
cycle 1 — 2 — 3 — — I — 1. Each vertex has two different configurations corresponding to the two permutations in S2 ■ 
In terms of the letter graph these correspond to the two different ways that the two incoming edges can be connected 
to the two outgoing edges. Since vertex i has one edge both to and from each of i ± 1, we can either 
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i-1 



1 2 

(a)closed configuration 



(b)open configuration 



FIG. 9: Vertex i is connected to i ± 1 by one edge in either direction. These edges can be connected to each other in two ways, 
which are depicted in (a) and (b). We call (a) a "closed" configuration and (b) an "open" configuration. 



(a) connect the incoming i — 1 edge to the outgoing i 
edge (the closed configuration) ; or, 



1 edge, and the incoming i + 1 edge to the outgoing i + 1 



(b) connect the incoming i — 1 edge to the outgoing i + 1 edge, and the incoming i 
edge (the open configuration). 



1 edge to the outgoing 



These possibilities are depicted in Fig. |H1 

Let c denote the number of vertices in closed configurations. These vertices can be selected in (^) ways. If 1 < c < i 
then c is also the number of cycles: to see this, note that each closed configuration caps two cycles and each cycle 
consists of a chain of open configurations that is capped by two closed configurations on either end. The exception is 
when c = 0. In this case, there are two cycles, each passing through each vertex exactly once. Thus, the RHS of (|62|) 
evaluates (exactly) to 



j2— m 



c=l 



= dr~ 



dr^{d 2 - 1) 



Combining everything, we find a contribution of x~z(l + o(l)) as d — > oo. In particular, when to is even this yields 
the lower bound claimed in Lemma HO We now turn to the case when c™ ax , £ and fa are not all equal to m/2. 

The sum over all terms. Our method for handling arbitrary values of c™ ax , £ and fa is to compare their contribution 
with the leading-order term. We find that if one of these variables is decreased we gain combinatorial factors, but 
also need to multiply by a power of 1/p or 1/d. The combinatorial factors will turn out to be polynomial in m, so 
if m is sufficiently small the contributions will be upper-bounded by a geometrically decreasing series. This process 
resembles (in spirit, if not in details) the process leading to Eq. (|3"Tj) in Section HT1 

Our strategy is to decompose the graph into a "standard" component which resembles the leading-order terms and 
a "non-standard" component that can be organized arbitrarily. The standard component is denned to be the set of 
2-cycles between degree-2 vertices. When £ = fa = c' 2 nax = ^ the entire graph is in the standard component, so when 
^,/t2,c™ ax s» the non-standard component should be small. Thus, in what follows, it will be helpful to keep in 
mind that the largest contributions come from when — £, — fa, — c™ ax are all small, and so our analysis will 
focus on this case. 

Begin by observing that there are £ — fa vertices with degree greater than two. Together these vertices have 
to — 2 fa in- and out-edges. Thus, they (possibly together with some of the degree-2 vertices) can participate in at 
most m — 2 fa 2-cycles. Fix a permutation ir for which €2(11) = c 2 nax . To account for all the 2-cycles, there must be 
at least df ax — (to — 2 fa) 2-cycles between degree-2 vertices. These 2-cycles amongst degree-2 vertices (the standard 
component) account for > 2c 2 nax — 2m + 4fa edges. Thus the number of non-standard edges entering and leaving 
the degree-2 vertices is < 2 fa - (2c™ ax - 2m + ifa) = 2m - 2c™* - 2 fa. Together we have < 3m - 2c™ ax - 4fa 
non-standard edges. 

We now bound the number of ways to place the m edges in G. First, we can order the degree-2 vertices in fa\ ways. 
This ordering will later be used to place the 2-cycles of the standard component. Next, we fix an arbitrary ordering 
for the £ — fa vertices with degree larger than two. We then place 



eNS 



:= 3m - 2c^ ax 



Afa 



non-standard edges. This can be done in < to 6ns ways. One way to see this is that each non-standard edge 
has m choices of destination, since we allow them to target specific incoming edges of their destination vertex. 
Call these destination edges ,I £NS }- These incoming edges correspond to eNS outgoing edges, which we call 

{0i, . . . , eNS }j an d which become the starting points of the non-standard edges. Without loss of generality we can 



sort {Oi 



, O eNS } according to some canonical ordering; let {0[, . . . , O ' } be the sorted version of the list. Then 



we let 0[ connect to Ii for i = 1, . . . , eNS- Since our ordering of . 



, } was arbitrary, this is enough to specify 
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any valid placement of the edges. Additionally, our choices of {Ii,... ,^e NS } also determine the degrees fii,...,/j,£ 
since they account for all of the incoming edges of the non-degree-2 vertices and out-degree equals in-degree. Note 
that nothing prevents non-standard edges from being used to create 2-cycles between degree-2 vertices. However we 
conservatively still consider such cycles to be part of the non-standard component. 

The remaining m — eNS = 2c 2 nax + 4/t2 — 2to edges (if this number is positive) make up 2-cycles between degree-2 
vertices, i.e. the standard component. Here we use the ordering of the degree-2 vertices. After the non-standard edges 
are placed, some degree-2 vertices will have all of their edges filled, some will have one incoming and one outgoing 
edge filled, and some will have none of their edges filled. Our method of placing 2-cycles is simply to place them 
between all pairs of neighbors (relative to our chosen ordering) whenever this is possible. 

We conclude that the total number of graphs is 



< /t 2 !m eNS 



< /x 2 !m 3m " 



c max_ 4 ^ 2 ^ ^| m 3m-2c™ ax -4/i2 



(65) 



In order to specify a string a, we need to additionally choose a starting edge. However, if we start within the standard 
component, the fact that we have already ordered the degree-2 vertices means that this choice is already accounted 
for. Thus we need only consider 



eNS 



eNS o3m— 2c 2 



1 < 2 eNS = 2 



-4/t2 



(66) 



initial edges, where we have used the fact that 1 + a < 2 a for any integer a. The total number of strings corresponding 
to given values of I, fi 2 , c 2 nax is then upper-bounded by the product of (|6"6")) and 



£\(2m) 



3m — 2c 2 nax — 4/i2 



(67) 



Observe that this matches the combinatorial factor for the leading-order term (a™ 3 * = (1% = I = m/2) and then 
degrades smoothly as c™ 3 *, /t2, 1 move away from to/ 2. 

Finally, we need to evaluate the sum over permutations in (1621) . Our choices for non-standard vertices are substan- 
tially more complicated than the open or closed options we had for the leading-order case. Fortunately, it suffices to 
analyze only whether each 2-cycle is present or absent. Since a 2-cycle consists of a pair of edges of the form (i, j) and 
(J, i), each such cycle can independently be present or absent. Thus, while there are /ii! • • • figl total elements of S^, 
we can break the sum into 2° 2 different groups of (/ii! • • • /j^!)/2 C2 permutations, each corresponding to a different 
subset of present 2-cycles. In other words, there are exactly 



„max\ ..I ..I 



2 C 2 



choices of it £ such that 02(71") = c. Using the fact that cyc(C m 7r) < (to + C2(7r))/3, we have 



EM < £ 



c=0 



„max\ .,| .. I 
C 2 \ (Ul! ' ' • 11V- m±c 



2 C 2 



-d— 



^1 ...fi t \ -2m+c 2 

- — max d 3 

max 



1 + (T3 



Finally, observe that /Ui! • • • jig}, is a convex function of /ii, . . . , m and thus is maximized when [i\ = m — 21 + 2 and 
/i2 = • • • = lit = 2 (ignoring the fact that we have already fixed (12)- Thus 



E d [(i] <(m-2£ + 2)!2*- x - C2 ' d" 

-2m+cS ia - x 



(i+d-*y 



< m m - 2l 2^- c *"~"d- 



(68) 
(69) 



where in the last step we used the facts that 2 < £ < to/ 2 and cjf 3 * < to/2. 
We now combine (l69t with the combinatorial factor in (l67l) to obtain 



sG[p] m 



4*1* < 



E E E : 

g< c max<m. Q<^<™ 3£_ m </j 2 <£ 



£!{2m) 



3m — 2c™ ax — 4/},2 



x 2 e2d 1 /3 



E 



n<c 2 nax <-r 

o<e<f 
3e-7n<ji 2 <e 



e2d L 



(2TO)' m_2c ™ ax ) + ( 2m_4 ^ 2 )m fc '" l_2£ ^2 fc ^~ c ™ ax ) 



(70) 
(71) 
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We can bound the sum over /I2 by introducing a = £ — /I2, so that 

m-2i 

(2m) 2 ^- 2 ^ = (2m) 2m -« ^ (2m) 4 " = (2m) 2m - u (\ + 16m 4 ) m -^ < (65m 6 ) m " 2 ' (72) 

3e-m</l2<£ a=0 

Substituting ([72 ]) in (fH]l and rearranging, we obtain 

/5000m 2fc+12 \ f ~* /2 2+fe TO 2 \ ¥ ~ c ™™ 



E„ r .1, m _«™_ ^-^ ^-^ / UUUUTO \ / Z III \ ,_„. 

£ d [ S f<^e^ 2 £ f j (^|— ) ^ 



sG[p] m 0<cg lax <^f o<e<^ 

R(s)=s 



e2d 



— 



< x t (74) 

_ ^ _ 5000m 2fc + 12 ^ ^ _ 2 2 +^m 2 ^ 

In the last step we have assumed that both terms in the denominator are positive. This completes the proof of 
Lemma |H □ 

C. Bounding the sum of all strings 

For any string s£ [p] m we will repeatedly remove repeats and unique letters until the remaining string is irreducible. 
Each letter in the original string either (a) appears in the final irreducible string, (b) is removed as a repeat of one 
of the letters appearing in the final irreducible string, or (c) is removed as part of a completely reducible substring. 
Call the letters A, B or C accordingly. Assign a weight of y/x'y 1 to each run of t A's, a weight of y f to each run 
of t B's and of J2l=o -^(^' fy^V* t° eacn run 01 t C's. Here y is an indeterminant, but we will see below that 

it can also be thought of as a small number. We will define G(x,y) to be the sum over all finite strings of A's, B's 
and C's, weighted according to the above scheme. Note that [y m )G(x, y) (i.e. the coefficient of y m in G(x,y)) is the 
contribution from strings of length to. 

We now relate G(x,y) to the sum in P5"j) . Define 



e 2d 1 / 3 

A = 



Y _ 5000m 2fc + 12 \ 2 2 + k 



m 2k + 12 \ U 
P J \ dt 

so that Lemma IH1 implies that the contribution from all irreducible strings of length t is < Aoy/x 1 as long as I < t < m. 
We will treat the t = case separately in Lemma El but for simplicity allow it to contribute a Aq^/x term to the 
present sum. Similarly, we ignore the fact that there are no irreducible strings of length 1, 2, 3 or 5, since we are only 
concerned with establishing an upper bound here. Thus 

E E d [s\ k <My m ]G(x,y)<A ^^-, (75) 

R(s)^<6 

where the second inequality holds for any yo within the radius of convergence of G. We will choose yo below, but first 
give a derivation of G(x, y). 

To properly count the contributions from completely reducible substrings (a.k.a. C's), we recall that F(x, y) counts 
all C strings of length > 0. Thus, it will be convenient to model a general string as starting with a run of or more 
C's, followed by one or more steps, each of which places either an A or a B, and then a run of or more C's. (We 
omit the case where the string consists entirely of C's, since this corresponds to completely reducible strings.) Thus, 

G(x, y) = F(x, y) ■ £ [,(1 + y&)F{x, »)] " = /^f^/'V (76) 
^/ 1 - y(l + y/x)F(x, y) 

which converges whenever F converges and y(l + \/x)F < 1. However, since we are only interested in the coefficient 
of y m we can simplify our calculations by summing over only n < to. We also omit the n = term, which corresponds 
to the case of completely reducible strings, which we treat separately. Thus, we have 



G m (x, y) := F(x, y) ■ £ + V^)F(x, y)} " . 
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and G m (x,y) satisfies [y m ]G m (x, y) = [y m ]G(x,y). 

Now define y = = (1 + \[x)~ 2 . Rewriting F as \ {y~ x + 1 — x — y 7 (y^ 1 — (1 + x)) 2 — Ax^j , we see that 

F(x,y ) = 1 + V^- Thus J/o(l + y/x)F(x,y ) = 1 and G m (x,y Q ) = m(l + y^)- 
Substituting into ([75]) completes the proof of the Lemma. 

D. Alternate models 

We now use the formalism from Section 1111 Bl to analyze some closely related random matrix ensembles that have 
been suggested by the information locking proposals of pjjj . The first ensemble we consider is one in which each 
{ifl) is a random unit vector in Aj ® Bj, then the Bj system is traced out. Let cIa = dim A\ = . . . = dim A k and 
(1b = dimBi = ... = dimBfe. The resulting matrix is 

k 

M pAA[dBlk := ^2 (8) tr %^- 

se[p] m j=i 

If cLb <C <1a then we expect the states tvBfs to be nearly proportional to mutually orthogonal rank-de projectors 
and so we expect M Pt d A [d B ],k to be nearly isospectral to M p ^ dA / dBk (gi rf , where r d := I d /d. Indeed, if we define 
E m , r , , , := trM m , , , , , then we have 

p,d A [d B \,k p,d A [d B \,k 

Lemma 11. 

m(m+l)fed B . / n < 

^p,d A [d B ],k ^ ^p,d A /d B ,k e A a B 

Proof. Define Ed A [d B ][s\ = tr(trs 1 ((pl t ) ■ ■ 'trg m (y>J ). Following the steps of (|B"2"j) . we see that 

7j d A [d 



Ed A [d B ][s\ = tr(C^ m ® 7 sm )E(^ Sl ® ■ • ■ V .J (77) 

<tr(cr«j flm ) s ' e ^"r B " ( 78 ) 

£ d cyc(C m .)- md cyc(.)- m ^ (?g) 



Next, we use the fact (proved in [2a|) that for any ir <E S m , cyc(C m 7r) + cyc(7r) < m + 1 to further bound 

/ j \ cyc(C m 7r) — m 

s dA[dB] [ S i < 2 d^^)— 4-^^ = 4-» ^ (^) ■ ( 8 °) 

On the other hand, if fit, . . . ,fi v are the letter frequencies of s then (|62p and (|2"3")) yield 

- nP j/it^rr — u * e rf cyc(cm,r) - m - (8i) 

d(d+ 1) • • • (d + Ms - 1) ^ 
Setting d = oIa/ ds and combining ([50)1 and (I5TT) yields the inequality 

E dA [d B ][A < E dA/dB [s\e m(T ^T R . 
We then raise both sides to the k th power and sum over s to establish the Lemma. □ 
To avoid lengthy digressions, we avoid presenting any lower bounds for -E^ a m b i k . 

Next, we also consider a model in which some of the random vectors are repeated, which was again first proposed 
in [23j]. Assume that p x l k is an integer. For s = 1, . . . ,p and j = 1, . . . , k, define 

S U) := 



P 1 - 



Note that as s ranges from l,...,p, ranges from 1, . . . ,p>/ k . Define M p ^,k = J2l=i \ i Ps)( l Ps\, where \(p a ) = 
<8> • • -® \(f k m ). In [23], large-deviation arguments were used to show that for x = o(l), ||M p ,d,fc|| = 1 + o(l) with 
high probability. Here we show that this can yield an alternate proof of our main result on the behavior of \\M p t d,k\\i 
at least for small values of x. In particular, we prove 
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Corollary 12. For all m,p,d,k, 

This implies that if A is a randomly drawn eigenvalue of M Pt ^ t k, A is a randomly drawn eigenvalue of M Pt d,k and 7 
is a real number, then Pr[A > 7] < Pr[A > 7]. In particular 

Pr[||AWll > 7] < d k Pr[\\M pAk \\ > 7]. 
The proof of Corollary 1121 is a direct consequence of the following Lemma, which may be of independent interest. 
Lemma 13. If = s'j whenever Si = Sj for some strings s , s* € [p] m then Ed[s\ < Ed[(>\- 

Proof. The hypothesis of the Lemma can be restated with no loss of generality as saying that s 1 is obtained from 
s by a series of merges, each of which replaces all instances of letters a, b with the letter a. We will prove the 
inequality for a single such merge. Next, we rearrange s so that the a's and b's are at the start of the string. This 
rearrangement corresponds to a permutation ir , so we have E d [s\ — tr7rJC m 7r E[(;9f Ma <£> ipf^ (g> U)] and E^] = 
tr irQC m iroE[(pf tla+tlb ® u], where to is a tensor product of various ip s , with s ^ {a, b}. Taking the expectation over 
uj yields a positive linear combination of various permutations, which we absorb into the 7rJC m 7ro term by using the 
cyclic property of the trace. Thus we find 

em = c - tr ^ E b? Mo ® vT b ® r 1 -^-^] (82) 

E d [s']= c w tr7rE[( / 3^« + ^ ® / m -^-^] (83) 

for some c w > 0. A single term in the Ed[s\ sum has the form c. n -E[|(yj a |y>;,)| 2 ^ 7r -'] for some f{-n) > 0, while for 
^[s*], the corresponding term is simply c w . Since E[|(<^ a |(^b)| 2 ^( 7r )] < 1, this establishes the desired inequality. □ 

IV. APPROACH 3: SCHWINGER-DYSON EQUATIONS 
A. Overview 

The final method we present uses the Schwinger-Dyson equations jTj| to evaluate traces of products of random pure 
states. First, we show how the expectation of a product of traces may be expressed as an expectation of a similar 
product involving fewer traces. This will allow us to simplify Ed\s\ k , and thus to obtain a recurrence relation for 



B. Expressions involving traces of random matrices 

1. Eliminating one ip: Haar random case 

We start by considering the case when k = 1 (i.e. are just Haar-random, without a tensor product structure). 
Let ip be a density matrix of a Haar-random state over C d . 

Let A\, . . . ,Aj be matrix- valued random variables that are independent of ip (but there may be dependencies 
between Ai). We would like to express 

¥,[tY{<pA 1 ipA 2 ...ipA 3 )\, 

by an expression that depends only on A\, . . . , Aj. First, if tp = \cp)((p\, then 

tr^Ai^ . . . tpAi) tr((pAi +1 ip . . . cpAj) = (p\Ai(p . . . ipAi\(p)((p\A i+1 ip . . . (pAj\(p) 

= (tp\A 1 p...A l tpA l+1 ...<pA j \cp) = tv(L P A 1 ...ipA j ). (84) 

This allows to merge expressions that involve the same matrix ip. 
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Second, observe that <p — U\0)(0\U^ , where U is a random unitary and |0) is a fixed state. By applying eq. (19) 
from 13 • we get 

1 ^ 

E[tr((pAi^A 2 ...ipA )]=--Y^ E[tr(y>Ai . . . ipA { ) \x(ipA l+1 . . . <pAj)] 

i=l 

1 3 

+ -J2E[ti{ipA 1 ...Ai-x<p) tr(A i (pA i+ x...<pA j )}. 

i—l 

Because of (|84|) . we can replace each term in the first sum by E[tr(y.Ai . . . <pAj)]. Moving those terms to the left hand 
side and multiplying everything by d+ '*_ 1 gives 



1 j 

E[tr(v3^i^A 2 . . . tpA,)] = J] E[tr(v>Ai . . . Aj_iy>) tr(A i¥ >A i+ i . . . ^A,)]. (85) 



3 

" J 

For i = j, we have 

tr(y>Ai . . . Aj_i¥j)tr(Aj) = tr((pAx . . . Aj-x) tr(Aj). (86) 

Here, we have applied tr(AB) = tr(BA) and ip 2 = ip. For i < j, we can rewrite 

tx((pAx . . . Ai-xy) tx{AnpA i+ x . . . ipAj) = tr(ipAx ■ ■ . A4-1) tr(<pAi + i . . . tpAjAi) 

= ti(ipAx . . . Ai-x<pA i+1 . . . cpAjAi). (87) 



By combining (|85|l. (|86[) and ([87]). we have 

E[tr(¥>AipA 2 . . . <Mj)] = + 1 ^[tr(^x . . . tpAj-i) tr(A,-)] + ^ E[tr(<Mi . • . ^-i^Aj+i . . . ^A)]^ (88) 
< ~ ^E[tr(^i . . . (pAj-JixtAj)] + E[tr(<Mi • • • A.^A l+1 . . . tpAjAi)]J . (89) 

2. Consequences 

Consider E[tr(y>i . . . (p m )] with ipi as described in section TlVAl Let Y\, . . . , Yi be the different matrix valued random 
variables that occur among <px, ■ ■ . , <p m . We can use the procedure described above to eliminate all occurrences of Y\. 
Then, we can apply it again to eliminate all occurrences of Y2, ■ • ., Yi-x, obtaining an expression that depends only 
on tr(Yi). Since tr(Yi) = 1, we can then evaluate the expression. 

Each application of ((88)) generates a sum of trace expressions with positive real coefficients. Therefore, the fi- 
nal expression in tr(Yj) is also a sum of terms that involve tr(Yj) with positive real coefficients. This means that 
E[tr(<pi . . . ipm)] is always a positive real. 



3. Eliminating one ip: the tensor product case 

We claim 

Lemma 14. Let ip be a tensor product of k Haar-random states in d dimensions and Ax,...,Aj be matrix-valued 
random variables which are independent from ip and whose values are tensor products of matrices in d dimensions. 
Then, 

1 + j k d- i / k j k i^k 

E[tr((pAi^A 2 . . . (pAj)] < — E[trfr?i4i . . . V^-x) tr(A,-)] + -jrjk 1^ ^M^M ■ ■ . Ai-xV>A i+ x . . . (fAjAi)]. 

i—l 
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Proof. Because of the tensor product structure, we can express 



ip = ip 1 <g> ip 2 <E) . . .ip k , 



A- = A <g> Aj 



A 



We have 



l[tt(<pAKpA 2 ■ ■ ■ <pAj)] = []E[tiVAy . . . ^4)]. 



1=1 



We expand each of terms in the product according to (|59")h Let Cq = E[tr(ip l A[ . . . </rA\-_x) tr(A)-)] and 



a = E[tr(^4 . . . A\_^ l A\ +1 . . . Lp l A)A\)] 

for i € {1,2,..., j — 1}. (Since each of k subsystems has equal dimension d and are identically distributed, the 
expectations Co, . . . , Cj_i are independent of I.) Then, from (|89p. we get 

E[tr(<Mi^2 . . . ^)] < l[(Co +Ci + ... + Cj^) = -j. ^ . . . £ C h ■ ■ ■ C ik . 



ii=0 ik=0 



Consider one term in this sum. Let r be the number of I for which i\ = 0. We apply the arithmetic-geometric mean 
inequality 



X\ + x 2 



Xk 



to 



xi 



if ii = 



dW^{C M ) k ifz,^0 



(In cases if r = or r — k, we just define x/ = C^, for all I € {1,2, ... , k}.) We now upper-bound the coefficients of 
(Co) k in the resulting sum. For (Co) k , we have a contribution of 1 from the term which has i\ = . . . = ih = and a 
contribution of at most dr x l k from every other term. Since there are at most j k terms, the coefficient of (Co) fc is at 
most 

i + 3 k <r x i k . 

The coefficient of (Cj) k in each term is at most d ik ~ r '> k . Since r < k — 1 (because the r = k terms only contain Go's), 
we have d< fc - r ) fc < d~*~ . The Lemma now follows from there being at most j k terms. □ 



C. Main results 



1. Haar random case 



We would like to upper-bound 



1 



p p 



s i — 1 s m = l 



E[tr(ip 81 . ..cp Sm )]. 



Lemma 15. 



m— 2 



m < \ "* J m-l- 



l „m-l-l i P + m e m-l 



2=0 



(90) 
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Proof. In section HVDll □ 
Using e° d 1 — tr(I)/d — 1, we can state Lemma [TBI equivalentlv as 



m < V p™-'- 1 -+- I P + m _ 1 ) p™- 1 fqi 



i-i-i , / P + tu 1 ^ m-1 

e p,d,l e p 

Z=0 



Define i = (p + m 3 )/<i (and note that it is not exactly the same as the variable of the same name in Section |TT|. Then 
([91) matches the recurrence for the Narayana coefficients in (|54|) . Thus we have 



Corollary 16. 

m 

e™ d)1 < X] 0^ = /?m (x) < (1 + V5) 2m (92) 

£=1 

Similar arguments (which we omit) establish the lower bound e™ d 1 > '^2 ll N(m 1 t)(p)t/(d + to) , which is only 
slightly weaker than the bound stated in Theorem [T] and proved in Lemma [S] 



2. Tensor product case 



The counterpart of Lemma [15] is 
Lemma 17. 

k \ ra — 1 



s I i i m \ I m-l-l ,1 V , \ m-l / c.\ 



Z=0 

1 + ^ £ 4.-. fc *«r l + f i + ^ - f 1 + ) ) e 7 ~l (94) 

(95) 



p 


3m fe+3 


d k ' 




p 


Q m fc+3 


d k ' 


h 3 dV* 



This time we set x k = + i I d Tjr- Also define 7 = m k /d 1 / k . Then Lemma [T71 implies that e™ d fc < (1 + 
7) m [2/ m ]^ 1 (5fc) where J 71 satisfies the recurrence 

F = 1 + yF 2 +y ( — 1 ) F. (96) 



1 + 7 



Thus we obtain 
Corollary 18. 



^,*< (1 + 7^(7^) (97) 

zA™ ^ /3m fc + 4 



<(^J An(s) < exp ( — ^ ] /3 m (z) (98) 



Proof. ([97|) follows from the preceding discussion as well as the relation between (3 m and the recurrence ([96]) . which 
was discussed in Section ITlI Al and in [3(1 Hl|. The first inequality in ([§5[) is because /3 m (a:(l + e)) < (1 + e) m (3 m (x) for 
& n y e > 0, which in turn follows from the fact that (3 m (x) is a degree-m polynomial in x with nonnegative coefficients. 
The second inequality follows from the inequality 1 + e < e e . □ 

D. Proofs 

1. Proof of Lemma \T5\ 
We divide the terms E[tr(y Sl . . . <p Sm )] into several types. 
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First, we consider terms for which si ^ {s2, . . . , s m }. Then, ip si is independent from ip S2 ...ip Sm . Because of 
linearity of expectation , we have 

E[tr(vJ Sl . • . <p B J] = tr(E[ip Sl ]E[ip S2 . . . ip s J) = tr (^E[^ S2 . . . <p, m ]\ = ^E[tr(^ S2 . . . ^ S J]. 

By summing over all possible s\ £ [p], the sum of all terms of this type is § times the sum of all possible 
E[tr(v? S2 . . . <p„ m )] with s\ <£ {s 2 , • • • , s m }, i.e., § times E™~^ dl . 
For the other terms, we can express them as 

E[tT(fp ai Yi<p ai Y 2 ...ip ai Y j )] (99) 

with Yi, . . . , Yj being products of ifi for i ^ s\. (Some of those products may be empty, i.e. equal to /.) 
To simplify the notation, we denote tp = ip Sl . Because of (|89|) , (|99|) is less than or equal to 



\ (jl E M<pYt<p . . . Yi-iYitp . . . ipYj] + E[tr(^Y l¥ >Y 2 . . . ipY^) tr(Yj)]J 



(100) 



We handle each of the two terms in (|100[) separately. For each the term in the sum, we will upper-bound the sum of 
them all (over all E[ti(ipYiipY2 . . . <pYj)]) by \ETj\ times the maximum number of times the same term can appear 
in the sum. 

Therefore, we have to answer the question: given a term E[tr(Zi . . . Z m —i)\, what is the maximum number of ways 
how this term can be generated as E\tt {ipY\ip . . . Yi_{Yiip . . . ipYj\1 

Observe that ip — Z\. Thus, given Z\ ...Z m -i, <fi is uniquely determined. Furthermore, there are at most m 
locations in Z\ . . . Z m -\ which could be the boundary between Yj_i and Yj. The original term E[tr(yYi . . . <pYi)] can 
then be recovered by adding tp in that location. Thus, each term can be generated in at most m ways and the sum 
of them all is at most ^E^l 

It remains to handle the terms of the form 

E[tr(^Y x ^y 2 . . . tpYj-x) trQ$)]- (101) 

We consider two cases: 

Case 1: There is no tpi which occurs both in Yj and in at least one of Yi,... i^j-i- Then, the matrix valued 
random variables i^Yiy^ . . . LpYj-\ and Yj are independent. Therefore, we can rewrite (|101|) as 

E[tr(^Y l¥ ;Y 2 . ..^-_i)]E[tr(Y-)]- (102) 

Fix Yi, . . . , Yj-i. Let I be the length of Yj and let o be the number of different tfn that occur in Y\ . . . Yj-\. Then, 
there are p — o — 1 different (p^s which can occur in Yj (i.e., all p possible <fiS, except for (p si and those o which occur 

in V; ...V ; ; :. 

Therefore, the sum of E[tr(Yj)] over all possible Yj is exactly E l p _ Q _ 1 d v We have E l p _ t d l < E l p _ _ 1 dl < E l pdl . 
Therefore, the sum of all terms (|102[) in which Yj is of length / is lower-bounded by the sum of all 

E l p _ w E[tT(ipY 1 ipY 2 ...<pY j - 1 )} 

which is equal to E^ ^E^ 1 ^ 1 . Similarly, it is upper-bounded by Ep id l E£j[~ l . 
Case 2: There exists ifi which occurs both in Yj and in some YJ, I G {1, . . . , j — 1}. 
We express Yj = Zip l W and Y = Z'tfiW. Then, ([Toljl is equal to 

E[tr(^Yx . . . Y^ W Z Vl W V Y l+1 . . . ^_ x ) tx{Z' Vi W') = 



E[tr(^Yi . ..Yi-xtpZipiW'Z'ipiWtpYi+x . 

In how many different ways could this give us the same term E[tr(Zi . . . 2T m _i)]? 

Given Z\,..., we know ip = Z\. Furthermore, we can recover Yj by specifying the location of the first ifi, 

the second ipi and the location where W ends and Z' begins. There are at most in — 1 choices for each of those three 
parameters. Once we specify them all, we can recover the original term (|101[) . Therefore, the sum of all terms (|101[) 
in this case is at most (m — l) 3 times the sum of all E[tr(Zi . . . Z m _i)], which is equal to E™ d \. 
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Overall, we get 

m ~ 2 I T \ 3 

pirn ^ P pm-1 _j_ TO rm- 1 , \ ^ j^l 771m— i—1 , v m ~ ' T? m ~ 1 f 1 OQA 

^ p ,d,i S + -J& P ,d,i + E pdl h pdl H ^ ^pAI' 

with the first term coming from the terms where Si ^ {S2, ■ • ■ , s^}, the second term coming from the bound on the 
sum in (|100[) and the third and the fourth terms coming from Cases 1 and 2. By combining the terms, we can rewrite 
(|T03l) as 

3 ^ m—2 

E£ d>1 < V —^El- d \ + EUlEpAf 1 - ( 104 ) 



1=0 



Dividing (|104l) by d completes the proof. 

We remark as well that these techniques can yield a lower bound for E p <^i. To do so, we apply the inequality 
l/(d + j — 1) > l/(d+ m) to (|88p. and then combine the lower bounds from the Si ^ {«2, ■ • ■ , Sfc} case and Case 1. 
(For the other cases, we can use as the lower bound, since we know that the expectation of any product of traces is 
positive.) This yields 

d + m e P,d,i e 7-ld\ + /rUij - e pU,f ( 105 ) 



2. Proof of Lemma\n\ 



The proof is the same as for Lemma [171 except that, instead of (|89|) we use Lemma [T4l 

The first term in (|103|) . Je-E^li d k , remains unchanged. The terms E[tr(<^Yi . . . Yi-iYnp . . . tpYj)] in (|100| are now 
multiplied by -Jrjk instead of We have -^-/tt < Jr/ir ■ Therefore, the second term in (|103j) changes from ^jE^^l to 

m k + 1 j?m— 1 

The terms E[tr(y>Yj . . . ipYj_i) tr(Yj)] in (llOOp acquire an additional factor of 1 + -Zjg < 1 + TpTE- This factor is 
then acquired by the third and the fourth terms in (|103[) . Thus, we get 



fe+l / k \ m — 2 / 

pn ^ P pm-1 , ™ pm-1 , | i , m VP 1 rm-l-1 , | i , 7 " 



The lemma now follows from merging the second term with the fourth term. 



\ (jn-iy 

I d %,d,k 



E. Relation to combinatorial approach 



The recursive approach of this section appears on its face to be quite different from the diagrammatic and combi- 
natorial methods discussed earlier. However, the key recursive step in (|85p (or equivalently ([55])) can be interpreted 
in terms of the sorts of sums over permutations seen in Section IIII1 

Consider an expression of the form X = E[tr(ipAitpA2 . . . <pAj)]. For the purposes of this argument, we will ignore 
the fact that Ai, . . . , Aj are random variables. Letting Cj denote the j-cycle, we can rewrite X as 

X = tr(CjE[^](Ai ® A 2 <8 • •• ® Aj)) = tr(E[<^'](Ai ® A 2 ® •• • ® A,-)), 

since Cjl^}®-? = li/?)' 8 ^. Next we apply (|6Tj) and obtain 

_ E^es, tr(7r(i4i <8> A 2 ® • • • ® A,-)) 
~ d(d+ 1) ■••(<* + ' 

We will depart here from the approach in Section IlIII by rewriting the sum over Sj. For 1 < i < j, let denote 
the permutation that exchanges positions i and j, with — e standing for the identity permutation. We also 

define <Sj_i C Sj to be the subgroup of permutations of the first j — 1 positions. Since (1, j), ■ • • , (j — 1, j), are 
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a complete set of coset representatives for iSj_i, it follows that any tt G Sj can be uniquely expressed in the form 
(«, j)7r' with 1 < j and tt 7 G Our expression for X then becomes 



1 



Aj 



d(d+l)---(d + j -2) J 
tr ( ^(ij)^- 1 <8 ® A 2 • • • ® A,-) 



3-1 



d + j-1 

= d+j- I 
1 

~ d + j-1 1 

which matches the expression in ([85]). or equivalently, 

The difference in approaches can then be seen as stemming from the different ways of summing over n G Sj. 
In Section HTT1 (and to some extent, Section [TTJ) , we analyzed the entire sum by identifying leading-order terms and 
deriving a perturbative expansion that accounted for all the other terms. By contrast, the approach of this section is 
based on reducing the sum over Sj to a similar sum over Sj-±. 



tr (ipA 1 ipA 2 ■ ■ ■ (pAj-x) tr(Aj) + tr(<pAi) ■ ■ ■ tt(<pAi-i)ix(Aj<pAi) tr(ipA i+ i) ■ ■ • tr^Aj-i) 



V. LOWER BOUNDS ON THE SPECTRUM 



The bulk of our paper has been concerned with showing that ||M|| is unlikely to be too large (Corollary [S]). Since 
we give asymptotically sharp bounds on d~ k E[ti M m ], we in fact obtain asymptotically convergent estimates of the 
eigenvalue density of M (Corollary [5]). However, this does not rule out the possibility that a single eigenvalue of M 
might be smaller than (1 — ^/x) 2 ; rather, it states that the expected number of such eigenvalues is o(d k ). 

In fact, our method was successful in proving asymptotically sharp estimates on the largest eigenvalue of M. We 
now turn to proving bounds on the smallest eigenvalue of M. To use the trace method to show that w.h.p. there are 
no small eigenvalues, one would like to upper bound expressions such as E[tr(M — XI) 2m ], for an appropriate choice 
of A. If we succeed in bounding such an expression then the A m i n (the smallest eigenvalue of M) is lower bounded by 

/ \ 1 j m 

E[(A - A min ) 2 ] < [EMM - XI) 2m ]j , (106) 

and hence 

/ s l/2m 

E[A min ] > A - (E[tr(Af - \I) 2rn ]\ . (107) 

Let us first describe a failed attempt to bound this result, before giving the correct approach. To bound E[tr(M — 
XI) 2m ], the natural first attempt is to use the expansion 

2m /Orn\ / \ 2m— n 

E[tr(M - A/) 2ro ] = ( )E[tr(M")H-Aj . (108) 

n=0 ^ U ' 

One might then attempt to estimate each term in the above expansion in turn. Unfortunately, what happens is the 
following: the leading order (rainbow) terms for E[tr(M™)] can be summed directly over n. One may show that this 
sum contributes a result to E[tr(M — \I) 2m ] which grows roughly as max{(( v / a : — l) 2 — A) 2m , {{\fx + l) 2 — A) 2m }. 
That is, it is dominated by either the largest or smallest eigenvalue of the limiting distribution, depending on the 
value of A. However, we are unable to control the corrections to this result. While they are suppressed in powers of 
1/d, they grow rapidly with m due to the binomial factor, causing this attempt to fail. 

We now describe a simple alternate approach. Let us work within the Feynman diagram framework. By (|15l) , the 
spectrum of M p ^,k is close to that of M Pl d,k with high probability, so we can translate bounds on A m i n in the Gaussian 
ensemble to bounds on the smallest eigenvalue in the normalized ensemble. 

Having reduced to the Gaussian ensemble, we now construct a diagrammatic series for E[tr(M — A/) 2m ]. One way 
to construct such a diagrammatic series is to add in extra diagrams, in which rather than having m pairs of vertices, 
we instead have n pairs of vertices, interspered with m — n "identity operators" , where nothing happens: the solid 
lines simply proceed straight through. However, there already is a particular contraction in our existing diagrammatic 
series in which solid lines proceed straight through. This is a particular contraction of neighboring vertices, in which 
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a dashed line connects the two vertices and all vertical lines leaving the two vertices are connected to each other. 
So, we can obtain the same result by using our original diagrammatic expansion, but with a change in the rules for 
weighting diagrams. If a a diagram has a certain number, c, of pairs of neighboring vertices contracted in the given 
way, then we adjust the weight of the diagram by 

p - X\ c x - A , 

^ = . (109) 



d k p 

If d p — A > 0, then this new series consists only of positive terms and we can use our previous techniques for 
estimating the series, bounding it by the sum of rainbow diagrams, plus higher order corrections. The sum of rainbow 
diagrams changes in this approach. One could use a new set of generating functionals to evaluate the new sum of 
rainbow diagrams, but we can in fact find the result more directly: we can directly use the fact that this sum is 
bounded by d k max{((V^ - l) 2 - A) 2m , ((y/x + l) 2 - A) 2m }. The corrections remain small. Taking the smallest value 
of A such that x — A > 0, we have A = x, and so we find that, for x > 1, the sum of these diagrams is bounded 
by d k (2y/x + l) 2m . This gives us a bound that, for any e > 0, the expectation value for the smallest eigenvalue is 
asymptotically greater than 

x-2y/x-l-e, (110) 

and hence using concentration of measure arguments and the above reduction to the Gaussian ensemble, we can then 
show that, for any e > 0, with high probability, the smallest eigenvalue of a matrix chosen randomly from the uniform 
ensemble is greater than or equal to x — 2^/x — 1 — e. 

On the other hand, if x < 1, then we will need to instead consider E[tr(M' — A/) 2 ™ 1 ] where M' is the Gram matrix 
of the ensemble. Since M' has the same spectrum as M but is only pxp, all of the terms in (|108[) are identical except 
that tr I equals p instead of d k . We can use a similar diagrammatic technique to incorporating the identity terms. 
Now each term of M contributes the pair of vertices from Fig.[2][a), but in the opposite order. Along the horizontal, 
the solid lines are the internal lines and the dashed lines are external. Now the identity diagrams correspond to the 
case when the dashed lines proceed straight through. These components of a diagram initially had a contribution of 
1 (with k closed solid loops canceling the natural d~ k contribution from each pair of vertices). Thus, adding in the 
— XI terms results in a multiplicative factor of (1 — A) for each vertex pair with the configuration where the dashed 
lines go straight through. Now we can choose A to be as large as 1 and still have each diagram be nonnegative. The 
resulting bound on E[tr(M' - XI) 2 " 1 } is pmax{(( v / x - l) 2 - l) 2m , ((y/x+ l) 2 - l) 2 " 1 } plus small corrections. We find 
that the smallest eigenvalue is > 1 — 2^/x — x — e with high probability. 

Combining these bounds, we find that the smallest eigenvalue is asymptotically no lower than (1 — \fx) 2 — 2 min(l, x). 
This is within a 1 — o(l) factor of the unproven-but-true value of (1 — \fx) 2 in the limits x — > and x — > oo. 

We believe that it should be possible to improve this result to get an asymptotic lower bound of (1 — y/x) 2 , staying 
within the framework of trace methods, using any of the three techniques we have used. This will require a more 
careful estimate of the negative terms to show that our methods remain valid. We leave the solution of this problem 
to future work. 
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